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Abstract. We establish some perturbed minimization principles, and we de- 
velop a theory of subdifferential calculus, for functions defined on Riemannian 
manifolds. Then we apply these results to show existence and uniqueness of 
viscosity solutions to Hamilton-Jacobi equations defined on Riemannian man- 
ifolds. 



1. Introduction 

The aim of this paper is threefold. First, we extend some perturbed minimization 
results such as the smooth variational principle of Deville, Godefroy and Zizler, 
and other almost-critical-point-spotting results, such as approximate Rolle's type 
theorems, to the realm of Riemannian manifolds. Second, we introduce a definition 
of subdifferential for functions defined on Riemannian manifolds, and we develop a 
theory of subdifferentiable calculus on such manifolds that allows most of the known 
applications of subdiffcrcntiability to be extended to Riemannian manifolds. For 
instance, we show that every convex function on a Riemannian manifold (that 
is, every function which is convex along geodesies) is everywhere subdifferentiable 
(on the other hand, every continuous function is superdifferentiable on a dense set, 
hence convex functions are differentiable on dense subsets of their domains). Third, 
we also use this theory to prove existence and uniqueness of viscosity solutions to 
Hamilton-Jacobi equations defined on Riemannian manifolds. Let us introduce 
some of these results. 

It is known that the classic Rolle's theorem fails in infinite-dimensions, that is, 
in every infinite-dimensional Banach space with a C 1 smooth (Lipschitz) bump 
function there are C 1 smooth (Lipschitz) functions which vanish outside a bounded 
open set and yet have a nonzero derivative everywhere inside this set; see [S] and 
the references therein. In fact, the failure of Rolle's theorem infinite dimensions 
takes on a much more dramatic form in a recent result of D. Azagra and M. Ce- 
pedello Boiso @|: the smooth functions with no critical points are dense in the 
space of continuous functions on every Hilbert manifold (this result may in turn 
be viewed as a very strong approximate version for infinite dimensional manifolds 
of the Morse-Sard theorem). So, when we are given a smooth function on an 
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infinite-dimensional Riemannian manifold we should not expect to be able to find 
any critical point, whatever the overall shape of this function is, as there might be 
none. This important difference between finite and infinite dimensions forces us to 
consider approximate substitutes of Rolle's theorem and the classic minimization 
principles, looking for the existence of arbitrarily small derivatives (instead of van- 
ishing ones) for every function satisfying (in an approximate manner) the conditions 
of the classical Rolle's theorem. This is what the papers [HE] deal with, one in the 
diffcrentiable case (showing for instance that if a differentiable function oscillates 
less than 2e on the boundary of a unit ball then there is a point inside the ball such 
that the derivative of the function has norm less than or equal to e), and the other 
in the subdifferentiable one. More generally, a lot of perturbed minimization (or 
variational) principles have been studied, perhaps the most remarkable being Eke- 
land's Principle, Borwein-Preiss' Principle, and Deville-Godefroy-Zizler's Smooth 
Variational Principle. See |27| |2H| and the references therein. 

There are many important applications of those variational principles. Therefore, 
it seems reasonable to look for analogues of these perturbed minimizations principles 
within the theory of Riemannian manifolds. In Section 3 we prove some almost- 
critical-point spotting results. First we establish an approximate version of Rolle's 
theorem which holds for differentiable mappings defined on subsets of arbitrary 
Riemannian manifolds. Then we give a version of Deville-Godefroy-Zizler smooth 
variational principle which holds for those complete Riemannian manifold M which 
are uniformly bumpable (meaning that there exists some numbers R > 1, r > such 
that for every point p £ M and every 8 £ (0, r) there exists a function b : M — > [0, 1] 
such that b(x) = if d(x,p) > 5, b(p) — 1, and sup xeM \\db(x)\\ x < R/S. Of course 
every Hilbert space is uniformly bumpable, and there are many other examples of 
uniformly bumpable manifolds: as we will see, every Riemannian manifold which 
has strictly positive injectivity and convexity radii is uniformly bumpable). For 
those Riemannian manifolds we show that, for every lower semicontinuous function 
/ : M — > (-co, oo] which is bounded below, there exists a C 1 smooth function 
ip : M — ► R, which is arbitrarily small and has an arbitrarily small derivative 
everywhere, such that / — ip attains a strong global minimum at some p £ M. 

This result leads up to one of the main topic of this paper: subdifferentiability 
of functions on Riemannian manifolds, since, according to the definition we are 
going to give of subdifferential, this implies that such / is subdifferentiable at the 
point p. We will say that a function f : M —> (— oo, oo] is subdifferentiable at p 
provided there exists a C 1 smooth function tp : M — » R such that f — <p attains 
a local minimum at p. The set of the derivatives dip(p) of all such functions ip 
will be called subdifferential of / at p, a subset of T*M p which will be denoted 
by D~ f(p). Of course, when M is R ra or a Hilbert space, this definition agrees 
with the usual one. Apart from being a useful generalization of the theory of 
subdifferentiability of convex functions, this notion of subdifferentiability plays a 
fundamental role in the study of Hamilton- Jacobi equations in R™ and infinite- 
dimensional Banach spaces. Not only is this concept necessary to understand the 
notion of viscosity solution (introduced by M. G. Crandall and P. L. Lions, see 
HaESHHlIIHlIISlIiailHlIiniEniEIl); from many results concerning subdifferentials 
one can also deduce relatively easy proofs of the existence, uniqueness and regularity 
of viscosity solutions to Hamilton- Jacobi equations; see, for instance, [22II23L I3"51l26| . 
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We refer to |24l |2H] for an introduction to subdifferential calculus in Banach spaces 
and its applications (especially Hamilton- Jacobi equations). 

Section 4 is devoted to the study of subdifferentials of functions denned on man- 
ifolds. We start by giving other equivalent definitions of subdifferentiability and 
superdifferentiability, including a local one through charts, which sometimes makes 
it easy to translate some results already established in the M. n or the Banach space 
cases to the setting of Riemannian manifolds. We also show that a function / is 
differentiable at a point p if and only if / is both subdifferentiable and superdif- 
ferentiable at p. Next we study the elementary properties of this subdifferential 
with respect to sums, products and composition, including direct and inverse fuzzy 
rules. We finish this section by establishing two mean value theorems, and showing 
that lower semicontinuous functions are subdifferentiable on dense subsets of their 
domains. 

In section 5 we study the links between convexity and (sub)differentiability of 
functions defined on Riemannian manifolds. Recall that a function / : M — > M 
defined on a Riemannian manifold M is said to be convex provided / o <j is convex, 
for every geodesic a. The papers [351 Kffil UTTl 138) provide a very good introduction 
to convexity on Riemannian manifolds and the geometrical implications of the exis- 
tence of global convex functions on a Riemannian manifold; for instance it is shown 
in |35| that every two-dimensional manifold which admits a global convex function 
which is locally nonconstant must be diffcomorphic to the plane, the cylinder, or 
the open Mobius strip. Among other things, we show in this section that every 
convex function defined on a Riemannian manifold is everywhere subdifferentiable, 
and is differentiable on a dense set (when the manifold is finite-dimensional, the set 
of points of nondifferentiability has measure zero) . 

Finally, in Section 6 we study some Hamilton-Jacobi equations defined on Rie- 
mannian manifolds (either finite or infinite-dimensional). Examples of Hamilton- 
Jacobi equations arise naturally in the setting of Riemannian manifolds, see yQ in 
relation to Lyapounov theory and optimal control. However, we do not know of 
any work that has studied nonsmooth solutions, in general, or viscosity solutions, in 
particular, to Hamilton-Jacobi equations defined on Riemannian manifolds . This 
may be due to the lack of a theory of nonsmooth calculus for functions defined 
on Riemannian manifolds. Here we will show how the subdifferential calculus and 
perturbed minimization principles that we develop in the previous sections can be 
applied to get results on existence and uniqueness of viscosity solutions to equations 
of the form 



where / : M — » K is a bounded uniformly continuous function, and F : T*M — *■ K is 
a function defined on the cotangent bundle of M which satisfies a uniform continuity 
condition. The manifold M must also satisfy that it has positive convexity and 
injectivity radii (this condition is automatically met by every compact manifold, for 
instance) . We also prove some results about "regularity" (meaning differentiability 
almost everywhere) of the viscosity solutions to some of these equations. Finally, 
we study the equation ^^(a;)!!^ = 1 for all x G O, u(x) — for all x S 90, where 
O is a bounded open subset of M , and we show that x i— > d(x, dQ) is the unique 
viscosity solution to this equation (which has no classical solution). 




4 



DANIEL AZAGRA, JUAN FERRERA, FERNANDO LOPEZ-MESAS. 



Let us also mention that one can develop other theories of subdifferentiability 
on Riemannian manifolds which have very interesting applications as well. For 
instance, one can consider quite natural extensions of the proximal subgradient 
and Clarke's generalized gradient for functions defined on Riemannian manifolds. 
By teaming these notions with infimal convolutions with squared geodesic distance 
functions one can get very interesting results about differentiability properties of 
the distance function to a closed subset of a Riemannian manifold; see [H]- 

2. Preliminaries and tools 

In this section we recall some definitions and known results about Riemannian 
manifolds which will be used later on. 

We will be dealing with functions defined on Riemannian manifolds (either finite 
or infinite-dimensional). A Riemannian manifold (M,g) is a C°° smooth manifold 
M modelled on some Hilbert space H (possibly infinite-dimensional) , such that for 
every p £ M we are given a scalar product g(p) = g p :— (•, -) p on the tangent space 
TM p ~ H so that ||a;||p = ({x, x) p ) 1 ^ 2 defines an equivalent norm on TM p for each 
p £ M, and in such a way that the mapping peMH g p £ S 2 {M) is a C°° section 
of the bundle (J2 '■ S2 ~> M of symmetric bilinear forms. 

If a function / : M — > R is differentiable at p £ M, the norm of the differential 
df(p) £ T*M p at the point p is defined by 

\\df(p)\\ p = sup{df(p)(v) : v £ TMp, \\v\\ p < 1}. 

Since (TM p , \\ ■ \\ p ) is a Hilbert space, we have a linear isometric identification 
between this space and its dual (T*M p , \\ ■ \\ p ) through the mapping TM p 9 x 1— > 
f x = x£ T*M p , where f x (y) = (x, y) for every y £ TM p . 

For every piecewise C 1 smooth path 7 : [a, b] —> M we define its length as 

L (l) = J \\-^i s )h(s)ds. 

This length depends only on the path 7 [a, b] itself, and not on the way the point 
j(t) moves along it: if h : [0, 1] — > [a, b] is a continuous monotone function then 
L(7 o h) = £(7). We can always assume that a path 7 is parameterized by arc 
length, which means that 7 : [0, T] — > M satisfies || -^{s)\\ 7 ( s ) = 1 f° r ah s, and 
therefore 

L (%o, r] ) = J \\-^( s )h(a)ds = r 

for each r £ [0, T]. For any two points p, q £ M , let us define 

d(p, q) = inf{£(7) : 7 is a C 1 smooth path joining p and q in M}. 

Then d is a metric on M (called the g-distance on M) which defines the same 
topology as the one M naturally has as a manifold. For this metric we define the 
closed ball of center p and radius r > as 

B g (p,r) = {qeM :d(p,q)<r}. 

Let us recall that in every Riemannian manifold there is a unique natural covariant 
derivation, namely the Levi-Civita connection (see Theorem 1.8.11 of 001); follow- 
ing Klingenberg we denote this derivation by VxY for any vector fields X,Y on 
M. We should also recall that a geodesic is a C°° smooth path 7 whose tangent is 
parallel along the path 7, that is, 7 satisfies the equation Vdj(t)/dtd"f(t)/dt = 0. A 
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geodesic always minimizes the distance between points which are close enough to 
each other. 

Any path 7 joining p and q in M such that L(j) — d(p, q) is a geodesic, and it 
is called a minimal geodesic. In the sequel all geodesic paths will be assumed to be 
parameterized by arc length, unless otherwise stated. 

Theorem 2.1 (Hopf-Rinow). If M is a finite- dimensional Riemannian manifold 
which is complete and connected, then there is at least one minimal geodesic con- 
necting any two points in M . 

On the other hand, for any given point p, the statement "q can be joined to p 
by a unique minimal geodesic" holds for almost every q £ M; see |43| . 

As is well known, the Hopf-Rinow theorem fails when M is infinite-dimensional, 
but Ekeland proved (by using his celebrated variational principle) that, even 
in infinite dimensions, the set of points that can be joined by a minimal geodesic 
in M is dense. 

Theorem 2.2 (Ekeland). If M is an infinite- dimensional Riemannian manifold 
which is complete and connected then, for any given point p, the set {q £ M : 
q can be joined to p by a unique minimal geodesic} is residual in M . 

The existence theorem for ODEs implies that for every V £ TM there is an 
open interval J(V) containing and a unique geodesic 7y : J(V) — > M with 
drf(0)/dt = V. This in turn implies that there is an open neighborhood TM of M 
in TM such that for every V £ TM, the geodesic yv(t) is defined for \t\ < 2. The 
exponential mapping exp : TM — > M is then defined as exp(V) = 7y(l), and the 
restriction of exp to a fiber TM X in TM is denoted by exp^. 

Let us now recall some useful properties of the exponential map. See |42l I4()j . 
for instance, for a proof of the following theorem. 

Theorem 2.3. For every Riemannian manifold (M,g) and every x £ M there 
exists a number r > and a map exp x : B(O x ,r) C TM X — » M such that 

(1) exp x : B(0 X ,S) — > Bm(x,5) is a bi-Lipschitz C°° diffeomorphism, for all 
Se(0,r]. 

(2) exp^ takes the segments passing through X and contained in B(O x ,r) C 
TM X into geodesic paths in BM{x,r). 

(3) dexp x (O x ) = idrM,,- 

In particular, taking into account condition (3), for every C > I, the radius r can 
be chosen to be small enough so that the mappings exp x : B(O x ,r) — » Bm{x,v) and 
exp" 1 : Bm{x,t) — > B(O x ,r) are C-Lipschitz. 

Recall that a Riemannian manifold M is said to be geodesically complete provided 
the maximal interval of definition of every geodesic in M is all of K. This amounts 
to saying that for every x £ M, the exponential map exp^, is defined on all of the 
tangent space TM X (though, of course, exp^. is not necessarily injective on all of 
TM X ). It is well known that every complete Riemannian manifold is geodesically 
complete. In fact we have the following result (see 02]) P- 224 for a proof). 

Proposition 2.4. Let (M,g) be a Riemannian manifold. Consider the following 
conditions: 

(1) M is complete (with respect to the g-distance). 
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(2) All geodesies in M are defined on R. 

(3) For every x G M, the exponential map exp x is defined on all of TM X . 

(4) There is some x G M such that the exponential map exp^, is defined on all 
of TM X . 

Then, (1) =>■ (2) ==>• (3) ==>■ (4). Furthermore, if we assume that M is 
finite-dimensional, then all of the four conditions are equivalent to a fifth: 

(5) Every closed and d g -bounded subset of M is compact. 

Next let us recall some results about convexity in Riemannian manifolds. 

Definition 2.5. We say that a subset U of a Riemannian manifold is convex if 
given ie, y G U there exists a unique geodesic in U joining x to y, and such that the 
length of the geodesic is dist(x, y). 

Every Riemannian manifold is locally convex, in the following sense. 

Theorem 2.6 (Whitehead). Let M be a Riemannian manifold. For every x G M , 
there exists c > such that for all r with < r < c, the open ball B(x,r) = 
exp x B(O x ,r) is convex. 

This theorem gives rise to the notion of uniformly locally convex manifold, which 
will be of interest when discussing smooth variational principles and Hamilton- 
Jacobi equations on Riemannian manifolds. 

Definition 2.7. We say that a Riemannian manifold M is uniformly locally convex 
provided that there exists c > such that for every x G M and every r with 
< r < c the ball B(x, r) — exp x B(0 X , r) is convex. 

This amounts to saying that the global convexity radius of M (as defined below) 
is strictly positive. 

Definition 2.8. The convexity radius of a point x £ M in a Riemannian manifold 
M is defined as the supremum in R+ of the numbers r > such that the ball B(x, r) 
is convex. We denote this supremum by c(M,x). We define the global convexity 
radius of M as c(M) := mf{c(M,x) : x G M}. 

Remark 2.9. By Whitehead's theorem we know that c(x, M) > for every x S M. 
On the other hand, the function x i— > c(x, M) is continuous on M, see 013 Corollary 
1.9.10]. Consequently, if M is compact, then c(M) > 0, that is, M is uniformly 
locally convex. 

The notion of injectivity radius of a Riemannian manifold will also play a role 
in the study of variational principles and Hamilton- Jacobi equations. Let us recall 
its definition. 

Definition 2.10. We define the injectivity radius of a Riemannian manifold M 
at a point x e M as the supremum in R+ of the numbers r > such that exp^, 
is a C°° diffeomorphism onto its image when restricted to the ball B(0 x ,r). We 
denote this supremum by i(M, x). The injectivity radius of M is defined by i(M) := 
inf{i(M, x) : x G M}. 

Remark 2.11. For a finite-dimensional manifold M, it can be seen that i(M,x) 
equals the supremum of the numbers r > such that exp^ is injective when re- 
stricted to the ball B(0 x ,r), see However, for infinite dimensional manifolds 
it is not quite clear if this is always true. 
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Remark 2.12. By Theorem 12.31 we know that i(x, M) > for every x € M. On 
the other hand, it is well known that the function x i— > i{x, M) is continuous on M 
40 Proposition 2.1.10]. Therefore, if M is compact, then i[M) > 0. 

We will also need to use the parallel translation of vectors along geodesies. Recall 
that, for a given curve 7 : / — > M, a number to, ti €E /, and a vector Vq S TM^^, 
there exists a unique parallel vector field V^(t) along 7(t) such that V(to) = Vq. 
Moreover, the mapping defined by Vo i-» V(t) is a linear isometry between the 
tangent spaces TM 1 ( (o j and TM^m, for each tel. We denote this mapping by 
P* = P* 7 , and we call it the parallel translation from TM 7 ( (| j to TA/ 7 ( t ) along 
the curve 7. 

The parallel translation will allow us to measure the length of the "difference" 
between vectors (or forms) which are in different tangent spaces (or in duals of 
tangent spaces, that is, fibers of the cotangent bundle), and do so in a natural 
way. Indeed, let 7 be a minimizing geodesic connecting two points x, y € M, say 
j(t ) = x,j(ti) = y. Take vectors V € TM X , W € TM y . Then we can define the 
distance between V and W as the number 

\\W-Pl\ y (V)\\ y = \\V-Pl^(W)\\ x 

(this equality holds because P^ 1 is a linear isometry between the two tangent spaces, 
with inverse P}°)- Since the spaces T*M X and TM X are isometrically identified by 
the formula v = (v, •), we can obviously use the same method to measure distances 
between forms £ € T*M X and 77 € T*M y lying in different fibers of the cotangent 
bundle. 

Finally, let us consider some mean value theorems. The following two results are 
easily deduced from the mean value theorem for functions of one variable, but it 
will be convenient to state and prove them for future reference. 

Theorem 2.13 (Mean value theorem). Let (M,g) be a Riemannian manifold, 
and f : M — ► M a Frechet differ entiable mapping. Then, for every pair of points 
p,q G M and every minimal geodesic path a : I — > M joining p and q, there exists 
to e / such that 

f(p) - /(?) = d(p,q)df(a(t Q ))(a'(t a )); 
in particular \ f(p) - f(q)\ < \\df(o-(t a ))\\ a{ta )d(p,q). 

Proof. Since a is a minimal geodesic we may assume / = [0, d(p, q)}, \\o~'(t)\\<T(t) = 1 
for all t £ I, <t(0) = q, <j(d{p 1 q)) = p. Consider the function h : I —t K defined by 
h{t) = f{o~{t)). By applying the mean value theorem to the function h we get a 
point to € I such that 

f(p) - /(?) = Hd(p, q)) - MO) = fc'(*b)(d(p, q) - 0) = df(*(toM<T'(t Q ))d(p, q), 

and, since ||cr'(to)||o-(* ) = 1 and l#( f7 (*o))(o-'(t ))| < \W(<r(to))\\a(t )i we also S et 
that \f(p)~f(q)\ < \\df(a(t a ))\\ aito) d(p,q). □ 

When the points cannot be joined by a minimal geodesic we have a less accurate 
but quite useful result which tells us that every function with a bounded derivative 
is Lipschitz with respect to the g-distance on M. In fact this results holds even 
for functions which take values in other Riemannian manifolds. For a differentiable 
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function between Ricmannian manifolds / : M — > N, we define the norm of the 
derivative df(p) at a point pgMby 

||4f(p)|| p := sup{\\df(p)(v)\\ m : h e TM P , ||t;|| p < 1} = 
sup{C(d/(p)(«)) : w e TM p ,C € T*7V /(p) , ||t,|| p = 1 = ||CI| /(p )}. 

Theorem 2.14 (Mean value inequality). Let M, N be Riemannian manifolds, and 
f : M — > N a Frechet differentiable mapping. Assume that f has a bounded deriv- 
ative, say \\df(x)\\ x < C for every x € M. Then f is C-Lipschitz, that is 

d N (f(p),f(q)) <Cd M (p,q) 

for all p,q e M. 

Proof. Fix any two points p,q £ M. Take any e > 0. By definition of d(p, q), there 
exists a C 1 smooth path 7 : [0, T] — > M with 7(0) = q, j(T) = p, and 

L{l) < d M {p,q) + ^; 

as usual we may assume ||7'(i)|| 7 (t) = 1 for all t e [0, T] = [0, £(7)]. By considering 
the path (3(t) := f("f(t)), which joins the points f(p) and f(q) in N, and bearing 
in mind the definitions of djv(/(p), f{q)) and the fact that ||rf7(i)|| 7 (t) = 1 f° r a h t, 
we get 

d N {f(p),f(q)) <L(p)= [ T \\d(3(t)\\m dt = f \\df{l{t)){dl{t))\\f^t))dt< 

Jo Jo 

[ \\dfh(t))\U(t)dt< [ Cdt = CT<C(d M (p,q)+e/C)=Cd M (p,q)+s. 
Jo Jo 

We have shown that djv(/(p), /(?)) < Cdu{p, q) + £ for every e > 0, which means 
that d N (/(p), /(g)) <Cd M (p,q)- ' □ 

In Section 4 below we will generalize these mean value theorems for the case of 
subdiffcrcntiable or superdifferentiable functions defined on Riemannian manifolds. 

The preceding mean value theorem has a converse, which is immediate in the 
case when M and N are Hilbert spaces, but requires some justification in the setting 
of Ricmannian manifolds. 

Proposition 2.15. Let M,N be Riemannian manifolds. If f : M — > N is K- 

Lipschitz (that is, dN (/ (x) , / (y)) < KdM(x,y) for all x,y e M), then \\df{x)\\ x < 
K for every x G M . 

Proof. Consider first the case when N = R. Suppose that there exists x n £ M with 
\\df(x )\\ xo > K. Take v e TM Xo so that || 

v olU — 1 an( i df(xo)(vo) > K. Consider 
the geodesic j(t) — exp Xa (tv ) defined for \t\ < r with r > small enough. Define 
F : [-ro.ro] -» R by F(t) = /( 7 (t)). We have that F'(0) = #(a;o)(vo) > A". By 
the definition of F'(0) we can find some Sq e (0, r ) such that 

Taking h = -S , t 2 = 5 we get - F(0) < 1ft 1 and F(i 2 ) - F(0) > lft 2 , 

hence, by summing, 

F(t 2 ) - F(h) > K(t 2 - ti). 
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If we set x\ = 7(ti), xi — 7(^2) this means that 

f(x 2 ) - f(xi) > K(t 2 - h) = Kd(x 2 ,x 1 ), 

which contradicts the fact that / is if-Lipschitz. 

Now let us consider the general case when the target space is a Riemannian 
manifold N. Suppose that \\df (xo)\\ Xo > K f° r some x £ M. Then there 
are Co £ T*N f ( Xo) and v £ TM X0 with ||"i> |U = 1 = HCo||/(> ) and such that 
K < \\df(x )\\ xa = Co (df (x )(vq)) . Take so > and e > small enough so that 
expj^j : B(f(xo), so) — > B(Oj( Xo ),So) is a (1 + e)-Lipschitz diffeomorphism and 
K < (1 + e)K < \\df(x )\\xo- Now take ro > small enough so that f(B(x , r )) C 
B(f(xo), so), and define the composition 

g : B{x ,r ) -> M, g(x) = Co( expj{ xo) (f (x))) . 

It is clear that g is (1 + e)i4T-Lipschitz. But, since dexpj^j (f(xo)) is the identity, 
we have that 

dg(x )(v ) = Co(dexpJ^ o) (f(x Q ))(df(xo)(v ))) = 
(o(df(x )(v )) = \\df(x )\\ xo > (l + e)K, 
and this contradicts the result we have just proved for the case N = M.. □ 



3. Almost-critical-point-spotting results 

As said in the introduction, in infinite dimensions one cannot generally hope to 
find any critical point for a given smooth function, whatever its shape, so one has 
to make do with almost critical points. 

An approximate Rolle's theorem 

We begin with an approximate version of Rolle's theorem which holds in every 
Riemannian manifold (even though it is infinite-dimensional) and ensures that every 
diffcrcntiablc function which has a small oscillation on the boundary of an open set 
whose closure is complete has an almost critical point. 

Theorem 3.1 (Approximate Rolle's theorem). Let (M,g) be a Riemannian man- 
ifold, U an open subset of M such that U is complete and bounded with respect to 
the g-distance, and po £ M , R > be such that B g {po, R) C U . Let f : U — > K be 
a continuous function which is differentiable on U . Then: 

(1) If sup f(U) > swpf(dU) then, for every r > there exists q £U such that 
\\df(q)\\ q < r. ' ' 

(2) // inf f(U) < inf f{dU) then, for every r > there exists q £ U such that 
\\df(q)J q <r. 

(3) // f(U) C [— s,s] for some e > 0, then there exists q £ U such that 
\\df{q)\\ q <e/R. 

Corollary 3.2. Let (M,g) be a complete Riemannian manifold, U a bounded open 
subset of M, and po £ M, R > be such that B g (po,R) C U, s > 0. Suppose that 
f{dU) C [— e,e\. Then there exists some q£U such that \\df(q)\\ q < e/R. 

To prove Theorem 13. II we begin with a simple lemma. 



10 



DANIEL AZAGRA, JUAN FERRERA, FERNANDO LOPEZ-MESAS. 



Lemma 3.3. Let (M,g) be a Riemannian manifold, and f : M — > K be a differ- 
entiable function on M. Suppose that \\df(p)\\ p > e > 0. Then there exist a number 
S > and two C 1 paths a, (3 : [0,6] — > M, parameterized by arc length, such that 

f(a(t)) < f(p) - et, and /(/?(<)) > f(p) + et, 

for all te (0,(5]. 

Proof. Let us show the existence of such a path a (a required path (3 can be obtained 
in a similar manner). Since ||d/(p)|| p > e, there exists h € TM p so that \\h\\ p = 1 
and df(p)(h) < —e. Then (by the characterization of the tangent space TM p as the 
set of derivatives of all smooth paths passing through p) we can choose a C 1 path 
a : [0,r] — > M, parameterized by arc length, such that 

^f(0)=h, anda(0)=p. 
dt 

Define the function F : [0,r] -> R by F(t) = f(a(t)). We have that 

F'(s) = df(a(s))(^(s)) 

for all s € [0,7"]. In particular, for s — 0, we have that ^'(0) = df(p)(h) < e, and 
therefore there exists some S > such that 

F(t)-F(0) ^ _ 
t 

for all t £ (0, S}. This means that f(a(t)) < f(p) - et for all t E (0, 5}. □ 

We will also make use of the following version of Ekeland's Variational Principle 
(see |nni f° r a proof). 

Theorem 3.4 (Ekeland's Variational Principle). Let X be a complete metric space, 

and let f : X > [— oo, oo) be a proper upper semicontinuous function which is 

bounded above. Let e > and xq S X such that f(xo) > sup{/(a;) : x £ X} — e. 
Then for every A with < A < 1 there exists a point z £ Dom(f) such that: 

(i) Xd(z,x ) < f(z)-f(x ) 

(ii) d(z, xq) < e/A 

(iii) Xd(x, z) + f(z) > f(x) whenever x ^ z. 



Proof of Theorem 13.11 

Case 1: Let n = sup f{U) — snpf(dU) > 0. Define X — (U,d g ), which is a 
complete metric space. Let n > 1 be large enough so that U C B g (po,n), and set 
A = min{7)/87i, r} > 0. Observe that, since the diameter of U is less than or equal 
to 2n, we have that \d(x,y) < for all x,y G U. Now, according to Ekeland's 
Variational Principlc l3.4l there exists q € U such that 

f(y) </(«) + Xd(y,q) for ally el. (1) 

In fact, it must be q £ U: if q S <9J7 then, taking a such that /(a) > sup /(£/) — r//4 
we would get 

sup/(L0 - 77/2 = (sup/(f/) - 7y/4) - ry/4 < f(a) - Xd(a,q) < /(g) < sup/(9C/), 
a contradiction. 
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We claim that ||d/(<z)||g < A < r. Indeed, assume that ||<i/(<z)||g > A. Then, 
according to Lemma 13.31 there would exist a C 1 path /3, parameterized by arc 
length, such that (3(0) — q and 

fW)) > m + At (2) 

for all t > small enough. By combining (1) and (2), we would get that 

f(q) + Xt< /(/}(t)) < /(g) + \d((3(t), l) < /(«) + A£C3| [0 , t] ) = /(g) + \t 

if t > is small enough; but this is a contradiction. 
Case 2: consider the function — / and apply Case (1). 
Case 3: We will consider two situations. 

Case 3.1: Suppose that f(pa) ^ 0. We may assume that f(po) < (the case 
f(po) > is analogous). Define A = e/R. According to Ekeland's Variational 
Principle, there exists q € U such that 

(i) d(p ,q) < £(/(po) - f(q)) < \(f(po) + e) < R, and 

(ii) f(q)<f(y) + Xd(y,q) if y ± q. 

The first property tells us that q G mtB g (po, R) C U. And, by using Lemma 
13.31 as in Case 1, it is immediately seen that the second property implies that 
||4f(g)||,<A = e/it 

Case 3.2: Suppose finally that f(po) = 0. We may assume that \\df (po)\\ Po > e/R 
(otherwise we are done). By Lemma f3. 31 there exist S > and a C 1 path a in U 
such that 

/(«(*)) < /bo) - |* 

if < t < S. Define x = a(S) € B g (p ,S). We have that 

f(x )<f(po)-~S = -~8<Q. 

By applying again Ekeland's Variational Principle with A = e/R we get a point 
q £ U such that 

(i) d(q, xo) < < =R-S, and 

(ii) /(<?) < /(y) + for a11 y + 1- 

Now, (i) implies that d(q,po) < rf(g,cco) + rf(xo,po) < R — 8 + 5 = R, that is, 
<7 € int_B 9 (po, ii) Q U. And, as above, bearing in mind Lemma l3.3l (ii) implies that 
\\df(q)\\ q <e/R.~ ' □ 

Remark 3.5. If U is not complete the result is obviously false: consider for instance 
M = (-1, l)cl,f/= (0, 1), <9£/ = {0}, /(x) = x. On the other hand, the estimate 
e/R is sharp, as this example shows: M = M., U = (—1, 1), f(x) = x, R = 1, po = 0, 

£ = 1. 

A smooth variational principle 

Now we turn our attention to perturbed minimization principles on Riemannian 
manifolds. Of course, since every Riemannian manifold is a metric space, Ekeland's 
variational principle quoted above holds true and is very useful in this setting: ev- 
ery lower semicontinuous function can be perturbed with a function whose shape 
is that of an almost flat cone in such a way that the difference attains a global 
minimum. But sometimes, especially when one wants to build a good theory of 
subdifferentiability, one needs results ensuring that the perturbation of the func- 
tion is smooth, that is, one needs to replace that cone with a smooth function 
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which is arbitrarily small and has an arbitrarily small Lipschitz constant. This is 
just what the Deville-Godefroy-Zizler Smooth Variational Principle does in those 
Banach spaces having C 1 smooth Lipschitz bump functions; see |27| . 

Unfortunately, the main ideas behind the proof of this Variational Principle 
in the case of Banach spaces cannot be transferred to the setting of Riemannian 
manifolds in full generality. One has to impose some restriction on the structure 
of the manifold in order that those ideas work. That is why we need the following 
definition. 

Definition 3.6. We will say that a Riemannian manifold M is uniformly bumpable 
provided there exist numbers R > 1 (possibly large) and r > (small) such that for 
every p £ M , S € (0, r) there exists a C 1 smooth function b : M — > [0, 1] such that: 

(1) b{p) = 1 

(2) b{x) = ifd(x,p) > S 

(3) su PxeM \\db(x)\\ x <R/5. 

Remark 3.7. It is easy to see that every Riemannian manifold M is bumpable, 
in the sense that for every p € M, S > 0, there exists a smooth bump function 
b : M — > [0, 1] with b(p) = 1, b(x) — for x B(p, 6), and b is Lipschitz, that is 
sup^gjy/ Hdb^lla; < oo. However it is not quite clear which Riemannian manifolds 
are uniformly bumpable. Of course every Hilbert space is uniformly bumpable, and 
there are many other natural examples of uniformly bumpable Riemannian mani- 
folds. In fact we do not know of any Riemannian manifold which is not uniformly 
bumpable. 

Open Problem 3.8. Is every Riemannian manifold uniformly bumpable? If not, 
provide useful characterizations of those Riemannian manifolds which are uniformly 
bumpable. 

The following Proposition provides some sufficient conditions for a Riemannian 
manifold to be uniformly bumpable: it is enough that exp^. is a diffeomorphism 
and preserves radial distances when restricted to balls of a fixed radius r > 0. 
This is always true when M is uniformly locally convex and has a strictly positive 
injectivity radius. 

Proposition 3.9. Let M be a Riemannian manifold. Consider the following six 
conditions: 

(1) M is compact. 

(2) M is finite-dimensional, complete, and has a strictly positive injectivity 
radius i{M). 

(3) M is uniformly locally convex and has a strictly positive injectivity radius. 

(4) There is a constant r > such that for every x S M the mapping exp x is 
defined on B(0 x ,r) C TM X and provides a C°° diffeomorphism 

exp^ : B(0 X , r) -> B(x, r), 

and the distance function is given here by the expression 

d(y,x) = || cxp- 1 ^)!^ for all y e B(x,r). 

(5) There is a constant r > such that for every x € M the distance function 
to x, y G M i ► d(y, x), is C°° smooth on the punctured ball B{x, r) \ {x}. 

(6) M is uniformly bumpable. 
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Then (1) => (2) => (3) ^ (4) (5) =s> (6). 

Proof. (1) ffi is a trivial consequence of Remark 12.1 21 

(2) (3): In Chapter 2], the injectivity radius of a point x £ M is 
characterized as the distance from x to the cut locus C{x) of x. Hence, for every 
r > with r < i(M) and every a; € M it is clear that exp^ is a diffeomorphism 
and preserves radial distances when restricted to balls of a fixed radius r > in the 
tangent space TM X , and M is uniformly locally convex. See Theorems 2.1.14 and 

2.1.12 of m. 

(3) (4): Since i[M) > 0, we know that there is some r\ > such that exp x 
is a diffeomorphism onto its image when restricted to the ball B(0 x ,ri), for all 
x £ M. The fact that M is uniformly locally convex clearly implies that there is 
some T2 > such that 

d(y,x) = || exp" 1 ^)!^ for all y £ B(x,r 2 ). 

We may obviously assume that r± = T2 := r. In particular exp^. maps B(0 X , r) onto 
B(x,r). 

(4) (3) is obvious. 

(4) ==>• (5) is trivial, since exp" 1 is a C°° diffeomorphism between those balls, 
||- is C°° smooth on TM x \{0 x }, and d(y,x) = \\ exp" 1 ^)^ for all y £ B(x,r). 

(5) => (6): Assume that the distance function y i— > d(y,x) is C°° smooth on 
B(x,r) \ {x}. Let 6* : R — > [0, 1] be a C°° smooth Lipschitz function such that 
6'~ 1 (1) = (-co, 1/3] and # _1 (0) = [l,oo). For a given point x € M and a number 
S € (0, r), define b : M —> [0, 1] by 

6(y)=e(J%, a; )). 

Taking into account the fact that the distance function y t— > d{y, x) is 1-Lipschitz 
and therefore the norm of its derivative is everywhere bounded by 1 (see Proposition 
I2.15fl . it is easy to check that b satisfies conditions 1-2-3 of Definition 13.61 for a 
constant R = ||0'||oo > 1 that only depends on the real function 8, but not on the 
point x G M, □ 

Remark 3.10. The condition that M has a strictly positive injectivity radius is not 
necessary in order that M is uniformly bumpable, as the following example shows. 
Let M be the surface of M 3 defined by the equation z = l/(x 2 + y 2 ), (x, y) ^ (0, 0), 
with the natural Riemannian structure inherited from K 3 . Then i{M) — 0, but, as 
is not difficult to see, M is uniformly bumpable. 

The following theorem is the natural extension of the Deville-Godefroy-Ziz- 
ler Smooth Variational Principle to Riemannian manifolds which are uniformly 
bumpable. Recall that a function F : M — * R U {+00} is said to attain a strong 
minimum at p provided F(p) = mf x ^M F(x) and lim^oo d(p n ,p) — whenever 
(jp n ) is a minimizing sequence (that is, if lim^oo F(p n ) — F(p)). 

Theorem 3.11 (DGZ Smooth Variational Principle). Let (M,g) be a complete 
Riemannian manifold which is uniformly bumpable, and let F : M — ► (—00, +00] 
be a lower semicontinuous function that is bounded below, F ^ +00. Then, for 
every 5 > there exists a bounded C 1 smooth function ip : M — ► K such that: 
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(1) F — ip attains its strong minimum in M , 

(2) H^Hoo := sup peM \ip(p)\ < S, and Hd^Hoo := sup peA/ \\dip(p)\\ p < S. 

Remark 3.12. The assumption that M is complete is necessary here, as the fol- 
lowing trivial example shows: M = (— 1, 1) C R, f(x) = x. 

We will split the proof of Theorem 13 . 1 II into three lemmas. In the sequel B(x 1 r) 
denotes the open ball of center x and radius r in the metric space M , and B(ip, r) 
stands for the open ball of center tp and radius r in the Banach space Y. 

Lemma 3.13. Let M be a complete metric space, and (Y, || • ||) be a Banach space 
of real-valued bounded and continuous functions on M satisfying the following con- 
ditions: 

(1) \\ip\\ > H^Hoo = sup{|v?(iz;)| : x S M} for every ip £ Y . 

(2) There are numbers C > 1, r > such that for every p £ M , e > and 5 £ 
(0, r) there exists a function b £ Y such that b(p) = e, ||6||y < Ce(l + 1/5), 
and b(x) — if x ^ B(p,S). 

Let f : M — ► MU {+00} be a lower semicontinuous function which is bounded below 
and such that Dom(f) = {x 6 M\f(x) < +00} 7^ 0. Then, the set G of all the 
functions ip £ Y such that f + ip attains a strong minimum in M contains a Gs 
dense subset ofY. 

Proof. Take a number N £ N such that N > 1/r, and for every ngN with n > N, 
consider the set 

U n = {ip £ Y\ 3x Q £ M : (/ + ip){x ) < inf{(/ + p){x)\x £ M\B(x , -)}}. 

n 

Let us see that U n is an open dense subset of Y . Indeed, 

• U n is open. Take tp £ U n . By the definition of U n there exists xo £ M such 
that (/ + <p)(x ) < inf{(/ + p)(x)\x £ M\B(x Q , i)}. Set 2p = inf{(/ + p)(x)\x £ 
M\B(x ,±)}-(f + (p)(x ) > 0. Then, since ||-||y > || -H^, we get that B Y {ip,p) C 
Boo(ip,p) C U n . 

• U n is dense in Y. Take ip £ Y and e > 0. Since f+<p is bounded below there exists 
x £ M such that (/ + <p)(x ) < inf{(/ + tp)(x)\x £ M} + e. Set now 5 = 1/n <r, 
and use condition (2) to find a function b £ Y such that b(xo) — e, \\b\\y < C(n+l)e, 
and6(a;) = for x B(x , ~). Then (/ + <^)(a;o) - b(x ) < inf{(/ + <p)(x)\x € M} 
and, if we define /i = —6, we have 

(/ + ¥> + h)(a;o) < inf{(/ + <p){x)\x £ M} < inf{(/ + ^)(a;)|a; ^ B(x , -)}. 

71 

Since inf{(/ + ^)(a;)|a; ^ B(x , i)} = inf{(/ + ^ + /i)(x)|a; g B(ac , ^)}, it is obvious 
that the above inequality implies that ip + h £ U n . On the other hand, we have 
H^Hy < CI 77 - + Since C and n are fixed and e can be taken to be arbitrarily 
small, this shows that ip G U n , and U n is dense in Y, 

Therefore we can apply Baire's theorem to conclude that the set G = f]^ =N U n 
is a Gs dense subset of Y. Now we must show that if ip £ G then / + ip attains 
a strong minimum in M. For each n > N, take x n £ M such that (/ + p)(x n ) < 
inf{(/ + ip){x)\x ^ B(x n , i)}. Clearly, Xk £ B(x n , i) if k > n, which implies that 
(x n )^L N is a Cauchy sequence in M and therefore converges to some xq £ M. Since 
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/ is lower semicontinuous and fX^ =N B(xq, 1/n) = {xo}, we get 

(/ + <p)(x ) < liminf(/ + <p)(x n ) < liminf[inf{(/ + v )(x)\x G M \ B(x , -)}] 

n 

= M{m£{(f + ip)(x)\x G M\B(x , -)} : n e N,n > N} 

n 

= mi{(f + ip)(x)\xeM\{x }}, 

which means that / + <p attains a global minimum at xq G M. 

Finally, let us check that in fact / + ip attains a strong minimum at the point 
xq. Suppose {y n } is a sequence in M such that (/ + g)(y n ) —>■ (/ + g)(xo) and 
(y n ) does not converge to xq. We may assume d(y n ,Xo) > £ for all n. Bearing in 
mind this inequality and the fact that xq — lima; n , we can take k G N such that 
d(xk,y n ) > h for all n, and therefore 

(/ + <p)(xo) < (/ + <p){x k ) < inf{(/ + <p)(x)\x t B(x k , 1)} < (/ + ^)(y n ) 

for all n, which contradicts the fact that (/ + <p)(y n ) —>•(/ + (f)(xo). □ 

Lemma 3.14. Let M be a uniformly bumpable Riemannian manifold. Then there 
are numbers C > l,r > swc/i that for every p G M, e > and 5 G (0, r) i/iere 
exists a C 1 smooth function b : M —> [0, e] such that: 

(1) b(p) = e = || oo := sup xGM |6(x)|. 

(2) Hd&Hoo := su P;ceM ||d&(x)|U < Ce/S. 

(3) b(x) = i/x ^ B(p,5). 

In particular, max{||b|| 0o , ||db||oo} < Ce(l + 1/6). 

Proof. The definition of uniformly bumpable manifold provides such b in the case 
when e = 1 . If e ^ 1, it is enough to consider b £ — eb. □ 

Lemma 3.15. Let (M,g) be a complete Riemannian manifold. Then the vector 
space Y — {ip : M — > R | <p is C 1 smooth, bounded and Lipschitz}, endowed with 
the norm ||<^||y = maxjll^Hoo, Hd^Hoo}, is a Banach space. 

Proof. It is obvious that (F, |j • |jy) is a normed space. We only have to show that Y 
is complete. Let (ip n ) be a Cauchy sequence with respect to the norm || • \\y- Since 
the uniform limit of a sequence of continuous mappings between metric spaces is 
continuous, it is obvious that (<p n ) uniformly converges to a continuous function 
y> : M — * R. Since T*M X is a complete normed space for each x G M, it is also 
clear that (d(p n ) converges to a function \p : M —f T*M defined by 

ijj(x) = lim dip n (x) 

n — >oo 

(where the limit is taken in TM X for each x £ M). Let us see that ip — dip. Take 
p G M. From Theorem 12.31 we know that there exists some r > (depending on 
p) such that the exponential mapping is defined on B(0 p ,r) C TM P and gives a 
diffeomorphism exp p : B(0 p ,r) — > B(p,r) such that the derivatives of exp p and its 
inverse (exp p ) _1 are bounded by 2 on B(0 P , r) and B(p, r) respectively; in particular 
exp provides a bi-Lipschitz diffeomorphism between these balls. We denote ip(h) = 
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(<p o exp )(/i), for h G B(O p ,r), and <p(0 p ) = dip(p) o (dexp p (O p )) = dip(p). We have 

_ „ 11/1,1 _ _ IH L Vh'- 

1 W 1 + 1 W ^ (0)( M }| + 

|(d(?n(0)-V(p))(||j|)|. (1) 

Let us first consider the expression | ^W-y(o)-(y„(ft.)-y,,(o)) | ^ applying the mean 
value inequality theorem we get 

\<p m (h) - <fm{0) - (&n(h) - p„(0))| < sup \\d!p m (x) - dip n (x)\\ p \\h\\ p < 

xGB(O p ,r) 

2\\dip m - rf^Hooll/illp. 

Since (<p n ) is a Cauchy sequence in Y we deduce that for every e > there exists 
no G N such that |£> m (/i) — £> m (0) — (ip n (h) — p n (0))\ < ( £ /3)||/i|| whenever m, n > no 
so, by letting m — > oo we get that |£>(ft) — ^(0) — {<p n {h) — ip n (0))\ < (e/3)||/i|| if 
n > n . 

On the other hand, the term \(d!p n (Q) — V'WXpjj )l m tne right side of inequality 
(1) above is less than e/3 when n is large enough; we may assume this happens if 
n > uq. 

Finally, if we fix n = n , the term I Vri0< ' h ) h ^ n ^ — dp no (0)(j^)\ can be made to 
be less than e/3 if \\h\\ is small enough, say \\h\\ < S. 

By combining these estimations we get that, for n = n , the left side of inequality 
(1) is less than e if \\h\\ < S. This shows that <p is differentiable at p, with dp(0 p ) = 
ip(p)- Hence ip is differentiable at p, with dip(p) = ip(p). 

To conclude that Y is a Banach space it only remains to check that dip = ip is 
continuous and bounded. Take e > 0. Since (ip n ) is a Cauchy sequence in Y, there 
exists no G N such that \\dip n (y) — dip m (y)\\ y < e for all y G M provided n, m > no. 
By letting m — > oo we deduce that \\dip n (y) — ip(y)\\ y < e f° r au 2/ € if n > no. 
That is, we have 

lim \\dip n - d^Hoo = 0. 

n^oo 

In particular, this implies that |) |] oc < oo, that is, ip is Lipschitz. Now we can 
show ip — dip is continuous. Take any p G M. As above, there exists r > such 
that exp p : B(0 p , r) — > £?(p, r) is a 2-Lipschitz diffcomorphism, and so is the inverse 
exp" 1 . Define <p — <p> o cxp p : B(0 p ,r) — > K. In order to see that is continuous 
at p it is enough to see that dip is continuous at p . By applying the mean value 
inequality we have that 

\\dp{x) - d${Q)\\ P < 

\\dy(x) - dip n (x)\\ p + \\d<p n (x) - d<p n (Q)\\ p + \\dp n (0) - d<p(Q)\\ p < 

2\\dp - dpnWoo + \\dip n (x) - dlp n (0)\\ p + 2\\dip - dipnWoo = 

4\\dip - dpnWoo + \\d!p n (x) - dip n (0)\\ p (2) 

for all n G N, x G B(0 P , r) C TM P . Since \\dip — dip n \\oc — > as n — > oo we can find 
no G N so that 

\\dip- dv?nolloo < e/8- (3) 
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Finally, since dtp no is continuous at P , there exists 5 € (0,r) such that 

\\dtp no (x) - d!p no {0)\\ p < E - (4) 

if ll^llp < 8. By combining (2), (3) and (4), we get that \\d(p(x) — d<p(0)\\ p < e if 
\\ x \\p < S. This shows that d£5 is continuous at P . □ 

Now the proof of Theorem l3.11l is an obvious combination of the above Lemmas. 

Remark 3.16. It should be noted that Lemma T3. 131 is quite a powerful statement 
from which a lot of other perturbed minimization principles can be obtained. For 
instance: 

(1) When we take M = X, a complete metric space, and Y is the space of all 
the Lipschitz and bounded functions / : X — > R, with the norm 

||/||y = H/Hoo + Lip(/) = H/lloc + su P{ l/( d ( ~y) (y)l ^,yeX, X ^y} 

(which satisfies (1) and (2) of Lemma [3.131 with C — 1 and any r), then 
we obtain a statement that is easily seen to imply Ekeland's variational 
principle. 

(2) When we consider M — X, a Banach space having a C 1 smooth Lipschitz 
bump function, and we define Y as the Banach space of C 1 smooth Lipschitz 
functions / : X —* R, with the norm 

ll/llr = ||/||oo + ||/'||oo, 
then we recover the known DGZ smooth variational principle for Banach 
spaces. 

(3) Let M — X be any metric space in which some notion of differentiability 
has been defined, and Y be a Banach space of differentiable (whatever this 
word should mean in this context) and Lipschitz functions / : X — > R, with 
the norm 

||/|k = |l/lloc + Lip(/). 
Suppose that X is uniformly bumpable in the sense that Y satisfies (2) 
of Lemma 13.131 Then we get a perturbed minimization principle with 
functions which are differentiable and Lipschitz. 

Open Problem 3.17. Is Theorem 13 . 1 1 1 true if one drops the assumption that M 
is uniformly bumpable? 



4. A NOTION OF VISCOSITY SUBDIFFERENTIAL FOR FUNCTIONS DEFINED ON 

RIEMANNIAN MANIFOLDS 

Definitions and basic properties 

Definition 4.1. Let (M, g) be a Riemannian manifold, and / : M — ► (-co, oo] be 
a proper function. We will say that / is subdifferentiable at a point p € dom(/) = 
{x 6 M : f(x) < oo} provided there exists a C 1 function ip : M — ► R such 
that / — (p attains a local minimum at the point p. In this case we will say that 
C = dip(p) e (TM p )* ~ H* = H is a subdifferential of / at p. We define the 
subdifferential set of / at p by 

D f(p) — {d<p(jp) '■ <f> € C 1 (M,R), / — ip attains a local minimum at ;?}, 
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a subset of T*M P . Similarly, we define 

D + f(p) = {d<p(p) ■ <p £ C 1 (M, R), / — ip attains a local maximum at p} } 

and we say that / is superdifferentiable at p provided D + f(p) ^ 0. 
For every ( £ D~ f(p) U D + f(p), the norm of ( is defined as 

IKIlp = supIICWI : h € TM p , \\h\\ p = 1}. 
Remark 4.2. The following properties are obvious from the definition: 

(f ) / is subdifferentiable at p if and only if — / is superdifferentiable at p, and 

D+(-f)(p) = -D-f(p). 

(2) If / has a local minimum at p then £ D~ f(p). 

(3) If h has a local maximum at p then £ D + f(p). 

Next we give other useful equivalent definitions of subdifferentiability. 

Theorem 4.3 (Characterizations of subdifferentiability). Let f : M — > (—00,00] 

fee a function defined on a Riemannian manifold, p £ M, and 77 e T*M p . The 
following statements are equivalent: 

(1) € D~f(p), that is, there exists a C 1 smooth function ip : M — > R so that 
f — ip attains a local minimum at p, and n = dip(j>). 

(2) There exists a function tp : M — > R so that f — tp attains a local minimum 
at p, <p is Frechet differ entiable at p, and n = dip(p). 

(3) For every chart h:U<zM^H with p £ U , if we take ( — n o dh^ 1 (h(p)) 
then we have that 

liminf (/°OWr)+")-/(P)-<C,tt) > o. 

v— >0 ||v|| 

(4) There exists a chart h : U C M — > H with p G U and such that, for 
( = n o dh^ 1 (h(p)), we have 

liminf (f'k-WW+v)-™-^) > o. 
,-0 || v || 

Moreover, if the function f is locally bounded below (that is, for every x £ M 
there is a neighborhood U of x such that f is bounded below on U ), then the above 
conditions are also equivalent to the following one: 

(5) There exists a C 1 smooth function ip : M — > R so that f — <p attains a global 
minimum at p, and 77 = d<p(p). 

Consequently, any of these statements can be taken as a definition of 77 e D~f(p). 
Analogous statements are equivalent in the case of a superdifferentiable function; 
in particular ( £ D + f(p) if and only if there exists a chart h : U C M — > H with 
p £ U and such that, for £ = n o dh^ 1 (h(p)), 

hmsup (/'OW+'Wfr)-^) < a 

v^O \\V\\ 

Proof. (1) =^> (2) and (3) (4) arc obvious. 

(2) =^> (3). If / — <p has a local minimum at p then g := f o h^ 1 — tp o h^ 1 has 
also a local minimum at h(p), which implies 

^ min£ 9{h(p) + v)-g(h{p)) > 
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and, by combining this inequality with the fact that 

Um j^o h- l ){h{p)+v) - { V oh^)(h(p)) - (C,v) = o 

v^O \\v\\ 

(because ( — d(<p o h^ 1 )(h(p)j), it is easily deduced that 

Uminf if ° h^){h{p) +v)-(fo h^)(h(p)) - (C, v) > Q 

v^O \\v\\ ~ 

(4) (1). In order to prove this we will use the following lemma, which is shown 

in [27) in a more general situation. 

Lemma 4.4. If V is an open set of a Hilbert space H , x G V , and F : V — > 

(—oo, oo] is a function satisfying 

liminf^ + ^-^-^^>0 

v~* \\v\\ 

for some t G H* , then there exists a C 1 smooth function ip : H — > M such that 
F — if) has a local minimum at x, and dip(x) = r . 

Take an open neighborhood V of p so that V C U. Note that F := f o is a 
function from the open subset h(U) of the Hilbert space H into (—00,00], and by 
the hypothesis we have that 

kinf Ml!l*M>o. 

u->0 \\v\\ 

By the preceding lemma, there exists a C 1 smooth function ip : h(U) — ► M such 
that F — ip has a local minimum at h(p) and £ = dip(h(p)). Let us define := 
ipoh : U — > K, which is a C 1 smooth function. It is clear that F oh — ipoh = f — <p 
has a local minimum at p, and d<f>(p) — dip(h(p)) o dh{p) — C dh(p) = rj. In order 
to finish the proof it is enough to extend <p to the complement of V by defining 
tp = 9(f), where 9 is a C 1 smooth Uryshon-type function which is valued 1 on the 
set V and outside U (such a function certainly exists because M has C°° smooth 
partitions of unity and V C U). It is obvious that (p keeps the relevant properties 
of (p. 

Finally, let us see that, when / is locally bounded below, (1) <f=> (5). Obvi- 
ously, (5) ==> (1). To see that (1) => (5), let us assume that there exists a C 1 
smooth function ip : M — > M and some r > such that = f(p)—tp(p) < f(x)—ip(x) 
if x G £>(p, r), and denote 77 = dip(p). We have to see that there exists a C 1 smooth 
function ^ : Af — > R such that / — ip attains a global minimum at p and d(p(p) = n. 

Consider the open set U = M \ B(p, r/2). Since / — ip is locally bounded below, 
for each x G U there exist 6 X > and m x G M such that B(x,8 x ) c J7 and 
TO z < /(?/) — "0(2/) f° r a ^ 2/ G B(x, 5 X ). Consider the open covering 

G := {B{x,5 x ) : x £ U}U {B(p,r)} 

of M. Since M has C°° smooth partitions of unity there exists a locally finite refine- 
ment {Ui}i e i of the covering G and a family of functions {ipi}iei C C°°(M, [0, 1]) 
so that supp(f/'i) C Ui for each i and X)ie/ ^ = 

For each i G 7, if f7, C B(p, r) then we define cti — 0. Otherwise we can pick 
some Xi G U — M \ B(p, r/2) such that Ui C B(xi, 5 Xi ), and in this case we define 
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m Xi . Now we can define our function ip : M — > R by 



tp(x) = ljj(x) + ^ a i^i( 



x ) 

iei 

It is clear that <p is a C 1 smooth function such that cp = ip on B(p,r/2) (indeed, 
take x G B(p, r/2); if x G then £7^ C B(p, r) because of the choice of the covering 
G and the S y , so on = 0, while for all the rest of j G I we have ipj(x) = 0; therefore 
<p(x) — ip{x) + = ip(x)). In particular, it follows that r\ = dip{p) — d(p(p). 

We claim that / — ip attains a global minimum at p. Indeed, fix x G M. If 
x € B(p, r/2) = M\U then, as we have just seen, <p(x) = ip(x), and = (f—ip)(p) < 
(f ~ ip)( x ) = (f ~ <p){ x )- If x G U then, for those i E I such that i £ {/; we have 
(/ — 1 P){ X ) > niij = cti, while ipj(x) = for those j E I with x ^ Uj. Therefore, 

f(x) - <ys(a;) = /(a;) - i/j(x) - aiipi(x) = 

iei 



f(x) - ip(x) - ^{aiipi(x) :i€ I,x€Ui}> 

sup{ai : i e I, x e Ui} - *^2{ai4>i(x) : i G I, x e U l } > = f(p) - ip(p), 

and f — tp has a global minimum at p. □ 

Corollary 4.5. Let / : M — > (— oo, oo] be a function defined on a Riemannian 
manifold, and let h : U C M — > ft.(L7) a H be a chart of M . Then, 

D-M = K o *(p) : C e h;^m (/°'--)Wrt|..)-/(riMC.) 

u— >o ||e| 

= {Codh(p):CeD-(foh- 1 )(h(p))}. 

Now we can show that subdifferentiable plus superdifferentiable equals differen- 
tiable. 

Proposition 4.6. A function f is differ entiable atp if and only if f is both subdif- 
ferentiable and superdifferentiable atp. In this case, {df(p)} = D~f(p) = D + f(p). 

Proof. Assume first that / is both subdifferentiable and superdifferentiable at p. 
Then there exist C 1 functions ip, ip : M — > R such that / — ip and f — ip have a 
local minimum and a local maximum at p, respectively. We can obviously assume 
f(p) — ip(p) — ip{p). Then these conditions mean that f(x) — ip(x) > and 
f{x) — ip(x) < for all x G U, where U is an open neighborhood of p. On 
the other hand, (/ — ip) — (/ — ip) = ip — ip has a local minimum at p, hence 
= d{ip — ip)(p) — dip(p) — dip(p). That is, we have that 

ip(x) < f{x) < ip(x) for all x G U, ip(p) ~ ijj{p) — f(j>), and dip(p) — dip(p). 

By using charts, it is an easy exercise to check that these conditions imply that / is 
differentiable at p, with df(p) = dip(p) = dtp(p); in particular this argument shows 
that {df(p)} = D-f(p) = D+f(p). 

Now, if / is differentiable at p then, by the chain rule, so is / o h^ 1 at h(p) for 
any chart h : U C M — > H; in particular, putting ( = d(f o h^ 1 )(h(p)), we have 

Um (foh-^(h(p)+v)-f(p)-(Cv) = Q 
t)-»o \\v\\ 

which, thanks to TheoremOl yields df(p) = ( o dh(p) G D~f(p) n D+f(p). □ 
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What the above proof really shows is the (not completely obvious) following 
result: a function / is differentiable at a point p if and only if its graph is trapped 
between the graphs of two C 1 smooth functions which have the same derivative at 
p and touch the graph of / at p. 

Corollary 4.7 (Criterion for differentiability). A function f : M — > K is Frechet 
differentiable at a point p if and only if there are C 1 smooth functions ip,ip : M — > M 
such that 

< fi x ) < ^{x) f or all x G M, (p(p) = ip(p) = f(p), and dcp{p) = dip(p). 

Let us say a few words about the relationship between subdifferentiability and 
continuity. In general, a subdifferentiable function need not be continuous. For 
instance, the function / : K — > K defined by f(x) = if x £ [0, 1], and 1 elsewhere, 
is Frechet subdifferentiable everywhere in R, and yet / is not continuous at and 
1. However, it is easy to see that subdifferentiability implies lower semicontinuity. 

Proposition 4.8. /// is subdifferentiable at p then f is lower semicontinuous at 
p. In the same way, superdifferentiability implies upper semicontinuity. 

Proof. The result is immediate in the case of a function g : V C H — > (— oo,oo]; 
indeed, if 



then liminf y^j. g(y) > g(x). The general case follows by applying Theorem l4.3l □ 

Some rules and fuzzy rules 

Next we study some properties of the subdifferentials related to composition, 
sum and product of subdifferentiable and differentiable functions. Of course, all 
the statements hold for superdifferentials as well, with obvious modifications. 

Proposition 4.9 (Chain rule). Let M, N be Riemannian manifolds, g : M — > N, 
and f : N — » (— oo, oo]. Assume that the function f is subdifferentiable at g{p), and 
that g is Frechet differentiable at p. Then the composition fog : M — > (—00,00] is 
subdifferentiable at p, and 



Proof. Take C € D~ f(g(p)), then there exists a function ip : N — > K so that / — ip 
has a local minimum at g(p), if is Frechet differentiable at g(p), and C = dtp(g(p)). 
In particular there exists e > such that f(y) — <p(y) > f(g(p)) ~ <fi(9{p)) whenever 
d(y,g(p)) < e. Define ip — tpo g. Since g is differentiable at p and ip is differentiable 
at g(p), by the chain rule it follows that ip is a function from M into R which is 
Frechet differentiable at p, with dip(p) = d(p(g(p)) o dg(p). Since g is continuous at 
p, there exists S > such that d(g(x), g(p)) < e for all x with d(x,p) < S. Then 
we get f{g{x)) - <p{g{x)) > f{g{p)) - (fi(g(p)) if d{x,p) < S, that is, / o g - if> has 
a local minimum at p. By Theorem I4.3[ fl) (2)], this ensures that fog is 

subdifferentiable at p, with C,odg{p) = dip(g(p))odg(p) = dip(p) £ D~ (f o g){p). □ 

The following example shows that the inclusion provided by Proposition 14.91 is 
strict, in general. 



lim inf 



g{x + v) - g{x) - (t,v) 



> 



{C o dg(p) : C S D-f(g(p))} QD~(fo g)(p). 
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Example 4.10. Let M = N = R, g(x) = \x\ 3 / 2 , f(y) = lyl 1 / 2 ; / o g(x) = |x| 3 / 4 . 
Then g is C 1 smooth on R, and we have dg(0) = 0, D~f(g(0)) = D~f(0) = 
(—00,00), D~(f o g)(0) — (—00,00). Therefore ( o dg(Q) = for every £ g 
0-/(5(0)). 

Corollary 4.11. Let M, A?~ be Riemannian manifolds, h : M —> N a C 1 diffeo- 
morphism. Then, f : M — > (—00,00] is subdifferentiable at p if and only if f o h^ 1 
is subdifferentiable at h(p), and 

D-f(p) = {C o dh(p) : C S D-(f o h-^hip))}. 

Proof. If / : M — > (—00, 00] is subdifferentiable at p then, by the preceding Propo- 
sition, / o hr 1 : N — ► (—00,00] is subdifferentiable at h(p) G ./V and, moreover, we 
know that if T € D~ f(p) then ( := T o dhT 1 ^)) e D~(fo h,- 1 )^)). Then 
T = C o dh(p), with C G D~(f o h-^ihip)). 

Conversely, if / o is subdifferentiable at /i(p) then, again by the preceding 
result, / = (/ o/i _1 )o/i is subdifferentiable atp and, for any ( £ D~ (f oh^ 1 )(h(p)), 
we have ( o dh(p) e D~ 1 ((fo h' 1 ) o h)(p) = D~f(p). □ 

Proposition 4.12 (Sum rule). For all functions /i,/ 2 : M — ► (—00,00], p e M, 
we have 

D~ hip) + D~ hip) C D-(/x+/ 2 )(p), 
and analogous inclusions hold for superdifferentials. 

Proof. Take S D~fi(p), i = 1,2. There are C 1 smooth functions </?j : M — > 
R such that fi — ipi have a minimum at p and Q = dipi(p) for i = 1,2. Then 
(/1 + f 2 ) — (ipi + tp 2 ) = ifi — Vi) + (/2 — ^2) clearly has a minimum at p, hence 
Ci + C2 = d(ipi + ¥>2)(p) belongs to D~(fi + / 2 )(p). □ 

When one of the functions involved in the sum is uniformly continuous the in- 
clusion provided by this statement can be reversed in a fuzzy way. This assumption 
is necessary in general, as a counterexample (in the Hilbert space) of Deville and 
Ivanov shows; see |29| . 

Theorem 4.13 (Fuzzy rule for the subdifferential of the sum). Let (M,g) be a 
Riemannian manifold. Let fx, fz '■ M — > K be such that fi is lower semicontinuous 
and $2 is uniformly continuous. Take p €E M , a chart {U, ip) with p <= U , £ € 
D~(f\ + f2)ip), £ > 0, and a neighborhood V of (p,C) * n ^ e cotangent bundle 
T*M. Then there exist Pi,P2 G U, £1 G fiipi), C2 € -D^fe) smc/i i/iai: 
(Pi, Ci ° aVbi)- 1 o dy?(pi) + C2 ° dip(p 2 y 1 o dip{pi)) E V for i = 1, 2; and |/j(p») - 
/i(p)| <e fori = 1,2. 

Proof. Fix a chart (£/,<£>) such that p £ U and T*C7 is diffeomorphic to U x H* 
through the canonical diffeomorphism L : T*U ^ U x H* defined by L(q,£) = 
(q, £ o dip(q)^ 1 ). The theorem can be reformulated as follows: /or every p S f , C € 
+ /2)(p), and e > 0, i/iere exist px,p 2 e U , (1 e £> _ /i(pi), C2 G D~ f 2 {p2) 
such that: d(pi,p 2 ) < e, \\(i ° dtpipi)^ 1 + C2 d(p(p 2 )^ 1 - ( ° d<^(p) _1 || < e, anrf 
I /i (Pi ) — fi (p) I < e f or i — 1>2. But this statement follows immediately from Deville 
and El Haddad's fuzzy rule for Banach spaces |25| applied to the functions fioip^ 1 
and f 2 o ip^ 1 . □ 
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Proposition 4.14 (Product rule). Suppose /i,/2 : M — > [0,oo) are functions 
subdifferentiable at p £ M. Then /1/2 is subdifferentiable atp, and 

h(p)D-h(p) + /a(p)D-/i(p) C D-{hf 2 ){p). 

Proof. If one of the functions vanishes at p then it has a minimum at p, and so does 
its product with the other function, hence the result obviously holds true (recall 
that if g has a minimum at p then € D~g(p)). Therefore we may assume that 
/i(p)>0 fori = 1,2. 

Pick Ci G D~fi(p), and find C 1 smooth functions cpi : M — ► M such that /j — ^ 
have a local minimum at p and £j = ckpi(p) for i = 1, 2. As usual we may assume 
that tpi(p) = fi{p), so that fi — <fii > 0. Since fi(p) = fi{p) > and ipi is continuous, 
there exists a neighborhood V of p such that ^ > on V. We may assume that V 
is small enough so that the restrictions of <fi — fi to V have a global minimum at 
p. Then we deduce that /1/2 > V1/2 > ViV^ on V, that is, 

(/1/2 - <pi(p2)(x) > = (/i/ 2 - ^iy>2)(p) for all xeV, 

which means that /1/2 — 931932 has a local minimum at p, and therefore 

h(p)(2 + /a(p)Ci = fi(p)d(fi2(p) + f 2 (p)dip 1 {p) = d{ip 1 ip 2 )(p) € D~{f x f 2 ){p). 

□ 

Remark 4.15. If the functions are not positive, the result is not necessarily true, 
as the following example shows: M — R, /i(x) = |x|, /2(ar) = — 1, p — (note that 
the function (fif2){%) = — \x\ is not subdifferentiable at 0). 

Topological and geometrical properties of the subdifferential sets. 

Proposition 4.16. D~f(p) and D + f(p) are closed and convex subsets ofT*M p . 
In particular, if f is locally Lipschitz then these sets are w* -compact as well. 

Proof. Let us first check that D~ f(p) is convex. Pick £1, £2 € D~f(p), and find C 1 
smooth functions (pi, tp 2 '■ M — > M such that dipi(p) = and (/ — Lpi)(x) > = 
(/ — fi)ip) f° r all 2: in a neighborhood of p. Take t <E [0, 1], and define the function 
(fit '■ M — ► M by ^pt(x) = (1 — £)<^i(x) + tkpi{x). It is immediately seen that c/3 t is a 
C 1 smooth function such that f — ft attains a local minimum at p, and therefore 

(l-t)( 1 +t( 2 = dip t (p)€D-f(p). 

Now let us see that D~f(p) is closed. Take a chart h : U <Z M —> H with 
p E U. Since <i/j(p) : TM p — * iJ is a linear isomorphism and (dh(p))* : H* — > 
(TM P Y (defined by (dh(p))* (() = ( o dh(p)) is a linear isomorphism as well, and, 
by Corollary 14. 51 we know that 

0~/(p) = {C°*(p) : C e r>-(/o OWp))} = (dh&yiD-ifoh-^ihip))), 

it is enough to show that D~(f o h^ 1 )(h(p)) is closed in ff*. That is, we have 
to show the result in the case of a function g : V <Z H —> (—00, 00] which is 
subdifferentiable at a point x. So let us prove that D~ g{x) is closed in (H* , || • ||). 
Let (p n ) C D~g(x) be such that ||p„ — p\\ — * 0, and let us check that p € D~g(x). 
We have 

liminf^ + ^-.f^-^^^O 
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for all n, and therefore 

,g(x + v) - g(x) - (p,v) 



lim inf : 

v->0 



= lim inf 



1 



(g(x + v) - g{x) - (p n ,v)) + n-n(Pn ~P,v) 



> liminf - — - (g(x + v) — g(x) — (p n , v)) + liminf — 7r(p n — P, v 



v^O \\V 

> + lim inf (p n - p, v) 

?>— >0 \\v\\ 



v^O \\v\\ 



\\Pn-p\\ 



for all n, that is, 



lim inf 

v— >0 



g(x + v) -g(x) - (p,v) 



> 



\\Pn-P\\ 



for all n £ N, and since \\p n — p\\ — > we deduce that 



liminf 9{X + V ^ - n 9 ^- M >0, 

v->a \\v\\ 

which means p £ D~ g(x). 

Finally, when / is locally Lipschitz, by composing with the inverse of the expo- 
nential map (which provides a Lipschitz chart on a neighborhood of each point) and 
using Corollary 14. 51 it is easily seen that D~ f(p) and D + f(j>) are bounded. Then, 
by the Alaoglu-Bourbaki Theorem it follows that these sets are «7*-compact. □ 



Density of the points of subdifferentiability 

As a consequence of the Smooth Variational Principle, every lower semicontinu- 
ous function is subdifferentiable on a dense subset of its domain. 

Proposition 4.17. Let M be a Riemannian manifold. If f : M — > (— oo,oo] 
is lower semicontinuous and proper then {p € dom(f) : D~ f(p) =/= 0} is dense in 
dom(f) := {x € M : f(x) < oo}. 

Proof. Assume first that M is complete and uniformly bumpablc (such is, for in- 
stance, the case when M is a Hilbert space H). In this case we can deduce the 
result directly by applying the Smooth Variational Principle 13. Ill as follows. Pick 
any point pg with /(po) < °°j an d any open neighborhood U of po- We must show 
that there is some p £ U such that D~ f{p) ^ 0. Since M has smooth partitions 
of unity, there is a C°° smooth function b : M — > [0, oo) such that b(y) > if and 
only if y G U. Consider the function g : M —* (— oo, oo] defined by 

b (y) 

The function g is lower semicontinuous on M, and C°° smooth on U. Then the sum 
f + g is lower semicontinuous, and (/ + g)(po) < +oo. According to the Smooth 
Variational Principle, there exists a C 1 smooth function <p : M — * R such that 
(/ +g) — <p attains a strong minimum at some point p £ M . In fact we have p £ U , 
because this function is valued +oo outside U. But, since the function <p — g is C 1 
smooth on U , and / — (tp — g) attains its minimum at p, we conclude that 

d(v-g)(p)eD-f(p)^<b. 
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Now let us consider the case when M is not necessarily complete or uniformly 
bumpable. Pick a point po G dom(/) and an open set U containing po- We may 
assume that U is small enough so that there is a chart h : U C V — > H. By 
Corollary 14.51 we know that, for any p G M, we have D~f(p) ^ if and only 
if D~(f o h^ 1 )(p) ^ 0, so it is enough to see that there is some x G h(U) with 
D-(f o h-^ix) ^ 0. Define F(x) = fo h-\x) if x G h(U), and F(x) = +oo 
otherwise. The function F is lower semicontinuous on H, and F = f oh^ 1 on h(U). 
Since the Hilbert space H is certainly complete and uniformly bumpable, we can 
apply the first part of the argument to find some x G h(U) so that ^ D~F(x) = 
D-ifoh-^ix). □ 

Mean value inequalities 

There are many subdifferential mean value inequality theorems for functions de- 
fined on Banach spaces. Here we will only consider two of them, which complement 
each other. The first one is due to Deville [22] and holds for all lower semicontinu- 
ous functions / defined on an open convex set of a Banach space, even if they are 
not required to be everywhere subdifferentiable, but it demands a bound for all of 
the subgradients of the function at all the points where it is subdifferentiable. The 
second one is due to Godefroy (who improved a similar previous result of Azagra 
and Deville) , see jSJ E] , and only demands the existence of one subdifferential or 
superdifferential which is bounded (by the same constant) at each point, but it 
requires the function to satisfy D~ f{x) U D + f(x) ^ for all the points x in the 
domain of / (an open convex subset of a Banach space). 

Next we extend these mean value inequality theorems to the setting of Riemann- 
ian manifolds. The main ideas of the proofs of these results could be adapted to 
obtain direct proofs which would be valid for the case of manifolds, but for shortness 
we choose here to deduce them from the Hilbert space case. 

Theorem 4.18 (Deville's mean value inequality). Let (M,g) be a Riemannian 
manifold, and let f : M — > K be a lower semicontinuous function. Assume that 
there exists a constant K > such that \\C\\p < K for all £ G D~ f(p) and p G M . 
Then, 

\f(p) - f(q)\ < Kd M (p, q) for all p, q G M. 

Proof. The result is true in the case when M = H is a Hilbert space [22] - F° r com- 
pleteness we give a hint of Deville's argument, which is an instructive application 
of the Smooth Variational Principle. By standard arguments it suffices to show 
the result locally (see the proof of the general case below). Fix xq G H. Since / 
is locally bounded below there are N, 6 > so that f(x) — f(xo) > —N whenever 
x G B(xo,2S). For fixed y G B(xo,5/4), e > 0, consider the function defined by 
F(x) = f{x) — f(y) — a(\\x — y\\) for \\x — y\\ < 6, and F(x) = +oo elsewhere, where 
a : [0,oo) — > [0, oo) is C 1 smooth and satisfies a(t) = (K + e)t if t < 5/2, a(5) > N, 
and a'(t) > K + e for all t > 0. If inf F < 0, by applying the Smooth Variational 
Principle one can get a point x 1 G B(y, S) \ {y} and a subgradient £ G D~ f{x\) so 
that || CI) > K, a contradiction. Hence F > 0, and by letting e — > the local result 
follows. See :22 for the details. 

Now consider the general case of a Riemannian manifold. Fix any two points 
p, q G M, and consider a continuous and piecewise C 1 smooth path 7 : [0, T] — » M, 
parameterized by arc length, with 7(0) = p,j(T) = q. Take e > 0. According to 
Theorem 12.81 for each x G j([0,T}) there exists r x > so that exp^, : B(Q x ,2r x ) c 



2(i 



DANIEL AZAGRA, JUAN FERRERA, FERNANDO LOPEZ-MESAS. 



TM X — > B(x, 2r x ) C M is a C°° diffeomorphism so that the derivatives of exp^, and 
exp" 1 are bounded by 1 + e on these balls. Since 7QO, T]) is compact, there are a 
finite collection of points x\ = p, x%, x n — q G 7(0, T] so that 

n 

j([0,T}) c\jB(x j>rj ), 
3=1 

where we denote Tj — r Xj for short. Set r — min{ri, r„}, and pick an to G N big 
enough so that T/to < r/2. Define t = < ti = T/m < ... < tj = jT/m < ... < 
T = t m , and consider the points a.j,bj with a.j = bj-i = 7(ij_i), j = 1, ...,to, and 
b m = l(t m ). 

For each j e {1, m — 1} we may choose an ij G {1, n} so that 

7[t H ,( i ]n% ) ,r ij )^8 1 

and we also set io = 1, i m = n (so that 2;^ = p and x.; m = g). Since the length of the 
restriction of 7 to [ij_i,tj], which we denote 7^, is ij — tj-% = T/m < r/2 < r^/2, 
this obviously means that 

7fe-i,*j] C />'•:•<•, .2/-, j 

for each j = 1, ...,to. In order to avoid an unnecessary burden of notation, in the 
sequel we denote yj = Xi j , and Sj — r^, for j = 0, 1, to. 

Consider the function fj : B(O yj7 2sj) — > M defined by f 3 ■. — f o exp % . By 
Corollary 14. 1 II we know that 

D-f 3 {x) = {Codexp w (i) : ( G £>" (/)(ex Py . (z))} 

for all x G S(0 Vj ,2sj). Since ||£|| a < X for all ( G D~f(y) with y G M, and 
||dexp v (i)|| < (1 + e) for all a; G B(0 Vj ,2sj), we deduce that < (1 + £)i^ 

for all 77 G D~fj(x), x G B(0 Vj ,2sj). Then we can apply the result for the case 
= TM Xj and the function /j to see that 

l/KO - /(M = |/,(exp-/K)) - /(exp-/(^))| < 
(1 + e)Kd TMv . ( exp-. 1 (a :! )),ex p -. 1 (6 J )) 

for all j — 1, 2, to. On the other hand, since exp^. 1 is (1 + e)-Lispchitz we also 
have 

d T M Vj (exp- 1 (a i )),exp^ 1 (6 i )) < (1 + e)d M (a j ,b j ) 
for all j — 1, 2, to. By combining these two last inequalities we deduce that 

!/(%) - < (1 + e) 2 Kd M (a j ,b j ) < (l + e) 2 K (' \\dj(t)\\dt 

for all j = 1, to. Therefore, 

m m 

i/(p) - = 1 E(/fa) - ^ E - /fooi ^ 

(l + efK^ \\dj(t)\\dt = {l+e) 2 K \\dj(t)\\dt = (1 + e) 2 KL(>y). 

By taking the infimum over the set of continuous and piecewise C 1 paths 7 joining 
p and q with length L(j), we get 

|/(?)-/(p)| < (l + e) 2 Kd M (q,p). 
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Finally, by letting e go to we obtain the desired inequality: \f(q) — f(p)\ < 
Kd M (q,p). □ 

Corollary 4.19. Let (M,g) be a Riemannian manifold, and let f : M > R be a 

continuous function. Then 

sup {HCIIp : C G D-f(p),p G M) = Sup{||C|| p : C G D+f(p),p G M} . 

These quantities are finite if and only if f is Lipschitz on M , and in this case they 
are equal to the Lipschitz constant of f. 

Theorem 4.20 (Godefroy's mean value inequality). Let (M,g) be a Riemannian 
manifold, and let f : M > K be a Borel function such that 

D-f{p)yjD+f(p)^$ 

for every p G M . Define $ : M — ► R &?/ 

$(p) = inf{||C|| P : C G D-f(p) U D+f(p)}. 
Then, for every path 7 : I — > M parameterized by arc length, one has that 

M(/(7W)) < f*(Tf(t))dt. 

Here /1 is the Lebesgue measure in R. 

Proof. The result is already proved in the case when M = 77 is a Hilbert space, 
see |33J. Let us see how the general case can be deduced. Let us denote I — [0, T], 
For a given e > 0, choose points t/j = a; ». , Oj , &j , and numbers Sj = r.i ,tj, exactly 
as in the proof of Theorem 14. 181 Let us denote fj = f o cxp y . : B(Q yj , 2s j) — > R, 
7^ = exp~ x o7 : 7 3 := [i 3 -_i,ij] -> B(0 yj ,2sj) C TM tJ , and 

- inf{||C|| % : C G D"/^*) U 7J+/,(x)} 

for each a; G B(0 yj ,2sj). Since D~fj(x) = {£ o ciexp y . (x) : C G 7) _ (/)(exp (x))} 
for all x G B(0 yj , 2s j), and exp % is (1 + e)-bi-Lipschitz on these balls, it is easy to 
see that <F,(x) < (1 + e)$(exp y . (x)) for all x G B(0 yj ,2sj). 

By applying the result for 77 = TM yj , the function fj and the path 7^ , we get 
that 



M(/(7^i))) = A»(/i(7i&))) < / *j(7i(*))dt, (1) 
for all j = 1, 2, to. But we also have that 

jf $i(7i(*))* < ^ (1 +e)$(exp y .(7j(*)))rfi = (1 +e) (2) 

By combining inequalities (1) and (2), and summing over j — 1, m, we get 

m m „ 

Kf(7(I))) <E^(/(7(^))) <E( 1 + £ ) / *(7W)^< 

i=l 7=1 Jl i 



(l + e)jr j §( 7 (t))dt = (l + e ) / $ 

7= 1 



( 7 (*))dt. 



Finally, by letting e go to we get ju(/( 7 (7))) < $( 7 (t))di. □ 
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Corollary 4.21. Let (M,g) be a Riemannian manifold, f : M — > R a Borel 
function such that for every p 6 M there exists £ £ D~ f(p) U D + f(p) with \\C\\p < 
-ftT . Then, 

m(JW))) < AX( 7 ) 

/or every path 7 : / — > M. In particular, when f is continuous it follows that 
\f(p) ~ f(q)\ < Kd M (p, q) for all p,q£M. 

5. (SUB)DIFFERENTIABILITY OF CONVEX FUNCTIONS ON RlEMANNIAN 

MANIFOLDS 

he aim of this section is to prove that every (continuous) convex function defined 
on a Riemannian manifold is everywhere subdifferentiable, and differentiable on a 
dense set. 

Definition 5.1. Let M be a Riemannian manifold. A function / : M — > R is said 
to be convex provided that the function /oer:/CR^Ris convex for every 
geodesic a : I — ► M (parameterized by arc length) . 

The following Proposition is probably known, at least in the case when M is 
finite-dimensional, but we provide a short proof for the reader's convenience, as we 
have not been able to find an explicit reference. 

Proposition 5.2. Let M be a Riemannian manifold. If a function f : M — ► R 
is convex and locally bounded, then f is locally Lipschitz. In particular, every 
continuous convex function is locally Lipschitz. 

Proof. Take p £ M. Since / is locally bounded there exists R > such that / 
is bounded on the ball B(p,R). According to Theorem 12.61 there exists r > 
with < r < R/2 such that the open balls B(p,2r) and B(p,r) are convex. Fix 
C = sup{/(x) : x £ B(p,2r)}, and m = inf{/(a;) : x € B(p,2r)}. We are going to 
see that / is if-Lispchitz on the ball B(p, r), where K = (C — m)/r. Indeed, take 
x\,X2 £ B(p, r). Since B(p, r) is convex, there exists a unique geodesic 7 : [t\, t^] ~ > 
B(p,r), with length d(x\,X2) = ti — t\, joining x\ to x%- Take v± £ TM Xl such 
that 7(i) = exp 2 . i ((t — for t > t\ small enough. Since the ball B(p,2r) is 

still convex and x\ £ B{p, r), we may define a geodesic g\ : \— r, r] — > B(p, 2r) C M 
through x\ by 

o\(t) = exp Xl (tvi) for all t £ [—r,r]. 
In the same way we may take V2 £ TM X2 and define a geodesic 02 : [—r, r] — > 
B(p,2r) C M through x 2 by 

o~2(t) = exp X2 (tv 2 ) for all t £ [— r, r], 

in such a way that j(t) = exp X2 ((t — t2)v2) for t < t2 with \t\ small enough. Set 
t A = tx — r, *4 = *2 + r, X3 = crx(—r), .x 4 = o- 2 {r), and I — [£3,^4]- Then, if we 
define a : I — > B(p, 2r) by 

C ax(t-tx) ifte[*3,ti]; 
a(t) = i 7 (t) ifte[*i,t a ]; 
[ a 2 (t-t 2 ) \it£[t 2l t A ], 

it is clear that er is a geodesic joining X3 to X4 in -B(p, 2r). Now, since / is convex, 
the function g : [t^, £4] C R — ► R defined as 

9(t) = /(*(<)) 
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is convex. Therefore we have 

g(*i) ~ g(«a) < gfe)-g(ti) < ,g(M - g(fr) 

fl — *3 *2 ^ t\ ti — ti 

where t% = t\ — r < t\ < t% < t% + r = t±. Bearing in mind that X3, X4 € 2r), 
and t 2 — tj = d(a;i, x 2 ), it follows that 

C-m < /(xi) - /(x 3 ) /(x 2 ) - /pEi) /(z 4 ) - /(rE 2 ) C-m 
r — r — £2) — r — r 

This shows that \f{xi) — f(x2)\ < Kd{x\,X2) for all £1,2:2 G B(p,r), where K — 
{C-m)/r. □ 

Let us recall that for a locally Lipschitz function F : H — > R on a Hilbert space 
if, we may define the generalized directional derivative F (x,v) as the 

Ffa + fa) - 
hm sup . 

(v,t)->(x,o+) t 

For every x G H, F°(x,v) is a subadditive positively homogeneous function of v, 
and the set {x* G H* : x*(v) < F°(x, v) for all v} is called the generalized gradient 
of F at x, and is denoted by dF(x). The generalized gradient is a nonempty, convex, 
w*-compact subset of H*\ see jllj for more information. 

Theorem 5.3. Let g : M — > K be a continuous convex function on a Riemannian 
manifold. Then g is subdifferentiable at every point of M . 

Proof. Let <p p : U p — > H be an exponential chart at p. We have 4*p{p) = 0- Given 
another point q € C/ p , take a (4> p ,v) € TM q , and denote £7g, (t) = <f>~ l {tw), where 
(<p p ,v) ~ {4> q ,w), which is a geodesic passing through g with derivative (<fi p ,v). 
Here, (<f> p ,v) ~ {4> q ,w) means that iu = o cf> p )(<fi p (q))(v), or equivalently 

u = o 0- 1 )(O,)(u'). 
Let us define 

f (P,v) = hmsup 2 

Claim 5.4. We have that f°(p,v) — inf t>0 ^""'^^"^^ , and consequently 

/ (P, «) = inf . 

Claim 5.5. There exists x* G if* such that x*(v) < f°(p,v) for every v E H. 

From these facts it follows that 

(/ o 4>- l )(tv) - {f o ^-i)(0) - x*(tv) > 

for every v G Sjj, and every t G [0, r), provided that B(0,r) C <j> p (U p ). Hence 
(/ o (ftp 1 ) — x* attains a minimum at and therefore x* G D~((f o 0~ 1 ))(0). We 
then conclude that D~ f(p) ^ by Corollary 14. 51 This shows the theorem. □ 

Proof of Claim 15*711 Fix a S > 0. Since / o a q v is convex we have that 
/ (p, v) — hm sup sup = 

£-►0+ d(p,q)<E8 0<t<e t 

= lim sup fMe))-fM0)) = ^ 

e->0+ d( p ,q)<eS £ 
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Next we estimate d(a p . v (e), a q . v (e)). We have 

d(a p . v (e),c7 q . v (e)) < K p \ \4> p {a p , v (e)) - <t> P ((T q , v (e))\ \ = K p \\sv - (f> p (a q , v (e))\\ = 
= K p \\sv-(0 p o4 ) ~ 1 )(ew)\\ =i^ p || £U -(^o^- 1 )(0)-ed(^o^- 1 )(0)( M )- O (e)|| = 
- K p \\(<j> p o ^(O) + o(e)\\ < K p (\\Mq)\\ + \\o(e)\\) < 
< K p {L p d{ P ,q) + \\o(e)\\) < K p (L p eS + eS) < CeS, 
where L p and K p are the Lipschitz constants of <fi p and (\>~ x respectively, C — 
K p (L p + l), and e is small enough so that ||o(e)|| < s5 and \\D(cj) p o(j>~ 1 )(v)~v\\ < 5. 

Since / is locally Lipschitz there exists K > so that / is if-Lispchitz on a 
neighborhood of p which may be assumed to be U p . From the above estimates we 
get that, for d(p, q) < e5, 

f(a q , v (e)) - /(<r,,«(0)) /(op,„(e)) - /K«(0)) 



< 



< \i\fMs)) ~ fMe))\ + |/(p) f(q)\) < 

< ^-(d(a p , v (e),a q , v (e)) + d{p, q)) < K(C + 1)6. 
Now we deduce that 

(*)< lim fMe))-f(°M0)) +K{c+1)s 

e^0+ e 



and, by letting 6 — > 0, we get 



f°(p,v) < lim 



f(v P ,v(t))-f(p) 



inf 

t>o 



f(v P At))-f(p) 



t t>0 £ 

Since the other inequality holds trivially the claim is proved. 
Proof of Claim 15.51 We have that 

i imsup /K^(*))-/K-(°)) _ m „ /K,W)-/K,(o)) 

g— >p t->0+ 



□ 



lim sup 

£^0+ d(p, q )<s 0<t<e 



t 



= lim sup 

£^0+ d(p,q)<£ 0<t<£ 



(/ o «^-l)(^K,(t)) - (/ o tfHMq)) 



= lim sup 

£ ^ 0+ d(p,q)<£ 0<t<£ 



F(y + X y (t)) - F(y) 



where (/ o <f> p 1 ) = F, y = p (g), and A y (i) = (f> p {<T q , v {t)) - <j> P (q)- Next we get 



lim sup 

£^0+ d(p,q)<e 0<t<; 



i^y + A^))-^) 



= lim sup 

£ ^ 0+ l|»l|<e 0<t<e 



F(y + A„(t))-F(y) 
t 



because < d(p,q) < K p \\y\\ (recall that 4> p and (<fi p ) 1 are Lipschitz). 

Now, if we take \ \y\ \ < e and < t < e, we have 

F(y + X y (t)) - F(y) F{y + tv)-F(y) _ F(y + X y (t)) - F(y + tv) 



< 



where if' is the Lipschitz constant of F and ip satisfies lim t _ >0 + fit) — 0, because 
A v (t) — tv = 4>p(a q , v (t)) - 4> p (q) — tv = o(t). 
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Finally, we have 



F(y + \ y (t)) - F(y) F(y + tv) - F(y) 

sup sup 



\\y\\<e 0<t<e t \\y\\<£ 0<t<£ t 



< 



< sup 

\\y\\<E 0<t<e 



F(y + X y (t)) - F(y) F(y + tv)-F(y) 



t t 
< K' sup ip(t), 

0<t<£ 



< 



which goes to as e — > + . Therefore f°(p, v) = F°(0, v) and x*(v) < f°(p, v) for 
every v € H , provided that x* £ dF(Q), the generalized gradient of F at 0. □ 

Theorem 5.6. Let g : M — > R be a continuous convex function on a complete 
Riemannian manifold. Then the set Diff(g) :— {x G M : g is differentiable at x} is 
dense in M . 

Proof. According to Proposition 14. 171 Diff + (g) := {p 6 M : D + g(p) ^ 0} is dense 
in M. On the other hand, by Theorem 15.31 we know that DifT(<7) := {p S M : 
D~g(p) ^ 0} = M. Then, by Proposition 14.61 we get that 

Diff( 5 ) = Diff+Cg) n DifT( 5 ) = Diff+( 5 ) is dense in M. 

□ 

By using more sophisticated tools, this result can be extended to the category 
of locally Lipschitz functions, as we next show. 

Theorem 5.7. Let g : M — > R be a locally Lipschitz function. If M is finite- 
dimensional, then g is differentiable almost everywhere, that is, the set M \ Diff(g) 
has measure zero. If M is infinite- dimensional, then the set of points of differen- 
tiability of g, Diff(g), is dense in M. 

Proof. Since M is separable, it suffices to prove the result for any small enough 
open set U C M so that g is Lipschitz on U . Take a point p € U . Since the 
exponential mapping at p is locally almost an isometry, in particular Lipschitz, it 
provides us with a chart h = <5> p : V — * H which is Lipschitz, for a suitably small 
open set V C U. Then the composition g o h^ 1 : h(V) C H — ► R is a Lipschitz 
function from an open subset of a Hilbert space into R. 

In the case when H is finite-dimensional, the classic theorem of Rademacher tells 
us that go h^ 1 is differentiable almost everywhere in h(V) (see and, since h is 
a C 1 diffeomorphism (so h preserves points of differentiability and sets of measure 
zero), it follows that g is differentiable almost everywhere in V. 

If H is infinite-dimensional then we can apply a celebrated theorem of Preiss 
that ensures that every Lipschitz function from an open set of an Asplund Banach 
space (such as the Hilbert space) has at least one point of differentiability |45|. By 
this theorem, it immediately follows that go h^ 1 is differentiable on a dense subset 
of h(V). Since again h is a C 1 diffeomorphism, we have that g is differentiable on 
a dense subset of V. 

Finally, since M can be covered by a countable union of such open sets V on 
each of which g is Lipschitz, the result follows. □ 

Corollary 5.8. Let M be a Riemannian manifold, and f : M — *■ R a convex and 
locally bounded function. Then f is differentiable on a dense subset of M (whose 
complement has measure zero if M is finite- dimensional) . 
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Proof. By Proposition 15. 21 we know that / is locally Lipscliitz. Then, by Theorem 
15.71 it follows that / is differentiable on a dense subset of M. □ 



6. Hamilton- Jacobi equations in Riemannian manifolds 

First order Hamilton-Jacobi equations are of the form 

F(x, u(x), du{x)) = 

in the stationary case, and of the form 

F(t, x, u(x, t), du(t, x)) = 

in the evolution case. These equations arise, for instance, in optimal control theory, 
Lyapounov theory, and differential games. 

Even in the simplest cases, such as the space R™, it is well known that very 
natural Hamilton-Jacobi equations do not always admit classical solutions. How- 
ever, weaker solutions, such as the so-called viscosity solutions, do exist under very 
general assumptions. There is quite a large amount of literature about viscosity 
solutions to Hamilton-Jacobi equations, see 0111111211311111311311311111111131 
1211 1271 and the references cited therein, for instance. All these works deal with 
Hamilton Jacobi equations in R™ or in infinite-dimensional Banach spaces. 

Examples of Hamilton-Jacobi equations also arise naturally in the setting of Rie- 
mannian manifolds, see pQ. However, we do not know of any work that has studied 
nonsmooth solutions, in general, or viscosity solutions, in particular, to Hamilton- 
Jacobi equations defined on Riemannian manifolds (either finite-dimensional or 
infinite-dimensional). This may be due to the lack of a theory of nonsmooth calcu- 
lus for functions defined on Riemannian manifolds. 

In this final section we will show how the subdifferential calculus we have devel- 
oped can be applied to get results on existence and uniqueness of viscosity solutions 
to some Hamilton-Jacobi equations defined on Riemannian manifolds. We will also 
prove some results about "regularity" (meaning Lipschitzness) of viscosity solutions 
to some of these equations. 

There are lots of Hamilton-Jacobi equations on Riemannian manifolds M for 
which the tools we have just developed could be used in one way or the other to get 
interesting results about viscosity solutions. For instance, one could get a maximum 
principle for stationary first order Hamilton-Jacobi equations of the type 

(u(x) + F(x, du(x)) = for all x € fi 
[ u(x) = for all x S dQ, 

where fl is an open submanifold of M with boundary dfl. One could also prove a 
maximum principle for parabolic Hamilton-Jacobi equations of the form 

(u t + F(x,u x ) = 0, 
\ u(0,x) = u (x), 

where u : R + x M — > R, and uq : M — ► R is an initial condition (assumed to be 
bounded and uniformly continuous), in the manner of [23 Section 6]. 

However, this final section is only intended to give a glimpse of the potential 
applications of nonsmooth calculus to the theory of Hamilton-Jacobi equations on 
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Riemannian manifolds, and not to elaborate a comprehensive treatise on such equa- 
tions. That is why we will restrict ourselves mainly to one of the most interesting 
examples of first-order Hamilton- Jacobi equations, namely equations of the form 

(u + G(du) = f 
\ u bounded, 

where / : M — > R is a bounded uniformly continuous function, and G : T*M — > R 
is a function defined on the cotangent bundle of M. In fact these equations are 
really of the form 

,,|«+ F{du) = 
\ u bounded, 

where F : T*M — > R, since we can always take a function F of the form F(x, £ x ) — 
G(x,£ x )-f(x). 

A bounded Frechet-differentiable function u : M — ► M is a classical solution of 
the equation (*) provided that 

u(p) + F(p, du(p)) = for every p e M. 

Let us now introduce the notion of viscosity solution. 

Definition 6.1. An upper semicontinuous (use) function u : M — > R is a viscosity 
subsolution of u + F(du) = if u(p)+F(p,() < for every p G M and C € D + u{p). 
A lower semicontinuous (lsc) function it : M — > R is a viscosity supersolution of 
it + F(du) = if u(p) + F(p, C) > for every p £ M and £ € D~u{p). A continuous 
function u : M — > R is a viscosity solution of it + F{du) — if it is both a viscosity 
subsolution and a viscosity supersolution of u + F(du) = 0. 

We can define viscosity solutions on a open set CI C M in a natural way when 
the functions are defined on f2. 

Remark 6.2. Since for a Frechet differentiable function u we have D + u(p) — 
D~u{p) = {du(p)} : it is clear that every bounded Frechet differentiable viscosity 
solution of u + F(du) — is a classical solution of (*). 

We are going to show the existence and uniqueness of viscosity solutions to 
Hamilton- Jacobi equations of the form (*) provided that F : T*M — * R is a function 
defined on the cotangent bundle of M which satisfies a certain uniform continuity 
condition, see Definition ltj . 1 Ol below . The manifold M must also satisfy the following 
requirement. 

Throughout the remainder of this section M will be a complete Riemannian 
manifold (either finite-dimensional or infinite-dimensional) such that M satisfies 
conditions (3) or (4) (which are both equivalent) of Proposition l3~^l that is, M is 
uniformly locally convex and has a strictly positive injectivity radius. Equivalently, 
there is a constant r = tm > such that for every x € M the mapping exp^, is 
defined on B(0 X , r) C TM X and provides a C°° diffeomorphism 

exp^ : B(0 X , r) -> B{x, r), 

and the distance function is given by the expression 

d{y,x) = || exp~ 1 (y)\\ x for all y G B(x,r), 

In particular, all compact manifolds satisfy this property. In the remainder of this 
section the constant r — tm will be fixed. 
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Note also that if M satisfies condition (3) of ProDOsition l3~^l thcn M is uniformly 
bumpable and therefore the Smooth Variational Principle 13. If I holds for M . 

We begin with a simple observation that if M is uniformly bumpable then so is 
M x M. 

Lemma 6.3. Let M be a Riemannian manifold. If M is uniformly bumpable then 
M x M is uniformly bumpable as well. 

Proof. The natural Riemannian structure in M x M induced by (M, g) is the one 
given by 

(9 X s)( Pl , P2 )((«i,«2), (w 1 ,w 2 )) ■= g Pl {vi,wi) + g P2 (v 2 ,w 2 ). 

Let cImxm denote the Riemannian distance that this metric gives rise to in the 
product M x M. It is obvious that if "/(t) = (a(t),[3(t)) is a path in M x M then 
a and (3 are paths in M satisfying 

max{L(a),L(/3)} < L( 7 ) < L(a) + L(f3) < 2 max{L(a), L{(3)}, 

which implies that 

max{d M (2:1,2/1), d M (x 2 ,y 2 )} < d M xM((xi,x 2 ), (2/1,2/2)) < 

d M (xx,yi) + d M (x 2 ,y 2 ) < 2max.{d M (xi,yi),d M (x 2 ,y2)} 

for every x = (xi,x 2 ),y = (2/1,2/2) € M x M. 

Since M is uniformly bumpable, there exist numbers R — Rm > 1 and ru > 
such that for every p g M , S £ (0, Tm) there exists a C 1 smooth function b : M — > 
[0,1] such that 6(po) = 1, &(^) = if dM{x,po) > (5, and sup^g^j ||rf6(a;)|| x < R/S. 
Now take a point p = (pi,p 2 ) £ M x M. For any S £ (0, rjf), there are C 1 smooth 
bumps 61,62 on M such that &i(j>i) = 1, bi{xi) — whenever dM{xi,Pi) > <5, 
and ||d6(xj)|| < R/S for every Xi £ M; i — 1,2. Define a C 1 smooth bump 
b : M X M R by 

6(x) = 6(a;i,a;2) = 61(^1)62(^2) for all x = (xi,X2) G M x Af. 

It is obvious that b(pi,p 2 ) = 1- If g?mxm(^,p) > 2<5 we have that 

2max{d M (xi,p 1 ), d M {x 2l p 2 )} > d MxM (x,p) > 26, 

so dM{xi,Pi) > S for some i £ {1, 2}, hence bi{xi) — for the same i, and b(x) = 0. 
Finally, we have that 

\\db(xi,x 2 )\\ 2 (xijX2) = Wdbiix^Wl + \\db 2 (x 2 )\\l 2 < 2(R/6f 1 

which means that 

\\db(x)\\ x < ^ 

for every x = (xi,x 2 ) £ M x M. Therefore M x M satisfies the conditions in 
Definition 13.61 with Rmxm = 2\/2R, and rMxM — 2ru- O 

Since we are assuming that M is uniformly locally convex and i(M) > r > 0, 
hence that the distance function y 1— > d(y,x) is C°° smooth on B(x,r) \ {x} for 
every x £ M, we can consider the distance function d : M x M — » R and its 
partial derivatives dd{xQ, yo)/dx and dd{xQ, yo)/dy. We next see that these partial 
derivatives satisfy a nice antisymmetry property. In order to compare them in a 
natural way we need to use the parallel translation from TM Xo to TM yo along the 
geodesic joining xq to 2/0 (note that there is a unique minimizing geodesic joining 
x to 2/0 because M is uniformly locally convex and d(xo,yo) < r). 
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Notation 6.4. Let xo,yo G M be such that d(xo,yo) < t. Let 7(i) = exp x (tvo), 
< £ < 1 be the unique minimizing geodesic joining these two points. For every 
vector w G TM Xo , we denote 

L x yo(w) = Po, y (w) 

the parallel translation of w from xq to yo along 7. Recall that the mapping 
L xoyo : TM X0 — > TM yo is a linear isometry, with inverse L yoXQ : TM yo — > TM X0 . As 
we customarily identify TAf p with T*M p (via the linear isometry u 1— > (u, ■ ) ) ; the 
isometry L xoyo induces another linear isometry between the cotangent fibers T* M xo 
and T*M yo . We will still denote this new isometry by L Xoyo : T*M Xo — > T*M yo . 

Lemma 6.5. Let x ,y e M be such that < d(xo,yo) < r. Then 

/ dd(y ,x ) \ _ dd(x ,y ) 
10 \ dy )~ dx ■ 



Lyaxa 



Proof. Denote vq = d(xo,yo) < r. Consider the geodesic j(t) = atp Xo (tvo) 1 < 
t < 1, where yo = exp^, (i>o)- By the definitions of parallel translation and geodesic 
it is clear that 

L Xo y (v ) = 7'(1) = dexp XB (v ){v ). 
On the other hand, under the current assumptions on M, and by the Gauss Lemma 
(see we know that 7'(1) is orthogonal to the sphere S(x ,r ) — {y G 

M : d(y,xo) = ?'o} = e^Pz. (S(0 XQ ,ro)). Since this sphere S(xo,ro) is a one- 
codimensional submanifold of M defined as the set of zeros of the smooth function 
y h- > d(y, .To) — ro and (as is easily checked) 

dd(y ,x ) 
dy 

we also have that this partial derivative is orthogonal to the sphere S(xq, tq) at the 
point yo. Therefore, 

T / \ //-.x dd(y ,x ) 
LxoyoM = 7 (1) = A ^ 

for some A ^ 0. Furthermore, since the function t i— > <i(7(i),xo) is increasing, we 
get that A > 0. Finally, it is clear that y 1— > <i(y,xo) is 1-Lipschitz, and 

dd(y Q ,x Q ) = i 
<9y 

from which we deduce that A = ||La; yo(wo)||yo = ll w olU , and 

dd(x ,y ) 
dy 

Now consider the geodesic f3(t) = exp yo (two), < t < 1, where exp yo (u;o) = To- 
By the definitions of parallel translation and geodesic we know that 

L Xoyo (vo) = -w Q , and \\w \\ yo = \\v \\ x „. (2) 
A completely analogous argument to the one we used for 7 above shows that 

dd (x ,y ) 
Ox 

By combining (1), (2) and (3) we immediately get that 



L x y ( v o) = \\vo\\x — • U) 



t ( \ 1 11 ^"V^u, yo; ,„n 
L y ^o{ w o) = 1 1 1^0 1 1 HI ■ ( 3 ) 



/ drf(yo,z ) \ ^ v = V K) = dd(x ,y ) 
V0X0 ^ dy ) |bo|U IKIU 5x 
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□ 



The following Proposition can be viewed as a perturbed minimization principle 
for the sum or the difference of two functions. Its proof is a consequence of the 
Smooth Variational Principle 13 . 1 II and Lemma \6. 51 



Proposition 6.6. Let u,v : M — > R be two bounded junctions which are upper 
semicontinuous (use) and lower semicontinuous (Isc) respectively. Then, for every 
e > 0, there exist xo,yo € M, and C £ D + u(xq), £ G D~v(yo) such that 

(i) d(x ,yo) < e, 

(ii) IIC -^oCOIUo <£ 

(hi) v(z) — u{z) > v(yo) — u(xq) — e for every z £ M . 
Here L VoXQ : T*M yo — ► T*M Xo stands for the parallel translation. 

Proof. We can obviously assume that e < r(M). Let b : R — > R be a C°° smooth 
function such that b is non-increasing, 

b{t) = 6(0) > 2(||w|| 00 + Halloo) + e if i < e/4, and 6(t) = if t > e. (1) 

Dehne the function w : M x M — > R by 

iu(x, y) = u(y) — u(x) — b(d(x, y)) for all (x, y) £ M x M. 

The function 10 is lower semicontinuous and bounded. By Lemma 16.31 we know 
that M X M is uniformly bumpable, and M x M is obviously complete, so we 
can apply the Smooth Variational Principle 13.111 to the function w to get a pair 
(^0) yo) E M x M and a C 1 smooth function g:MxM->l such that 

(a) HfflU < e/2 > HdffHoo 

(b) u(y) - u{x) - 6(d(x, y)) - g(x, y) > v(y ) - u(x Q ) ~ b(d(x , y )) - g(x , y ) 
for all x, y G M . 

If we take x = xq in (6) we get that v is subdifferentiable at the point yo, and 
:= g,g(x ,yo) + d(bod)(xo,y ) e D _ 

In a similar manner, by taking y = yo in (6) we get that 

C := -(^^ + ^°^°' yo) ) € /?+«(*„). (3) 

Let us note that 

'd(bod)(x ,yo)\ , 9(6 o d)(x , yo)) 



f d{t>ocL)(xo,y ) } 
vaxa \ dv J 



b'(d(x ,y )) L yoXo ( 



dy ) dx 

dd(x ,y )\ , dd(x ,yo) 



dy ) dx 



= 0, (4) 
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thanks to Lemma 16.51 when xq ^ yo, and to the definition of 6 when xq = yo- 
Therefore, 

ll^ao^O (£) ~ Cll 3=0 = 

I, T f dg(x ,yo) \ ( d(b o d)(x , y ) \ dg(xo,y ) d(b o d)(x , y ) 

\\^yoxo{ g y )+^o* { dy )+ dx + dx llxo 

I, T f dg(x ,y ) } | dg(x a ,y ) u 



^"V a y dx 11X0 

II q- II Vo + II lUo < \\ d 9\\oo + ||dp||oo < 2 + 2 ' 

which shows (ii). 

On the other hand, if we had d(xo, yo) > e then, by taking x = y = z in (6) we 
would get 

6(0) < v(z) - u[z) - g(z, z) + g(x , y ) - v(y ) + u(x ) < 

2(|H|oo + H|oo)+e, 

which contradicts the definition of 6, see (1) above. Therefore d(xo,yo) < e and (i) 
is proved. 

Finally, if we take z = x = y in (6) and we bear in mind that ||g||oo < e/2 and 
the function b is non-increasing, we get that 

v{z) - u(z) > v(y ) - u(x ) + 6(0) - b(d(x ,y Q )) + g(z, z) - g(x ,yo) > 

v(y ) - u(x ) + - e/2 - e/2 = u(y ) - u(»o) - e, 

which shows (Hi) and finishes the proof. □ 

Remark 6.7. Let us observe that the preceding proposition is no longer true if 
the manifold is not complete. For example: M — (0, 1) C R, g(x) = x, f(x) = 0, 
and £ > small. 

Definition 6.8. For a given open set flcM and a function u : £1 — *■ R, we define 
the upper semicontinuous envelope of u, which we denote it*, by 

u*(x) = inf{u(a;) | v : £1 — > K is continuous and u < v on f2} for any 2; G fi. 

In a similar way we define the lower semicontinuous envelope, denoted by u*. 

Proposition 6.9. Let Q be an open subset of M . Let T be a uniformly bounded 
family of upper semicontinuous functions on Q, and let u = sup{u : v G J-}. Then, 
for every p £ Q, and every £ G D + u*(p), there exist sequences {v n } C T , and 
{{Pn,Cn)} C T*(Q), with G D + v n (p n ) and such that 

(1) ]im n v n (p n ) = u*(p) 

(2) Um„(p n ,Cn) = ip,0- 

Proof. Fix a chart (U, ip), with p G U . Let us consider the family Toip^ 1 = {voip^ 1 : 
v G J-}. The functions of this collection are upper semicontinuous on <p{U (~lf2), and 
the family is uniformly bounded. On the other hand uotp~ l = sup{voip~ l : v G J-}, 
and u* o cp^ 1 = (uo (p^ 1 )* . Now apply |23 Proposition VIII. 1.6] (which is nothing 
but the result we want to prove in the case of a Banach space) to the Hilbert space, 
the open set ip(Unft), the family Totp^ 1 , the point <p(p), and the superdifferential 
Codip(p)^ 1 G D + (uoip~ 1 )(ip(j))). We get sequences {<f(p n )} in (p(U(lSl), {!i n o^ -1 } 
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in T o ip 1 , and Cn ° dtp(p) 1 e -D + (v„ o tp 1 ){<p(p n )) such that lim„ ip(p n ) = f{p), 
lim„ o dip{p)^ 1 — C o e£<£(p) _1 , and 

lim(u„ o <^~ 1 )(^(p„)) = (iio^ 1 )'^)) = u* o p _1 (#>(p)). 

n 

Hence lim„p„ = p, Um n u„(p„) = u*(p), and 

limC„ o dv3(p„) _1 = HmC„ o dip^y 1 o d<p(p) o dtpljpy 1 = limC„ ° dipip)' 1 

n n n 

because ip is C , so lim„ dip(p n )~ 1 o dip(p) — id. The result follows trivially from 
the local representation of the cotangent bundle. □ 

Now we introduce the notion of uniform continuity that we have to require of 
F : T*M — * K in order to prove the existence and uniqueness of viscosity solutions 
to the Hamilton- Jacobi equation (*). 

Definition 6.10. We will say that a function F : T*M — > R is intrinsically uni- 
formly continuous provided that for every e > there exists 6 € (0, tm) such that 

d(x,y)<6,<;eT*M x ,ZeT*M y , ||C--M0IU<<S => \F(x,Q - F(y,{)\ <e. 

Remark 6.11. It should be noted that if F satisfies the above definition then F 
is continuous. This is obvious once we notice that the mapping 

(x,()eT*M x ^L XX0 (Q 

is continuous at (x , Co), that is, if (x n , C„) — * (x , (a) in T*M then L XnXo (( n ) — > Co, 
for every (a^o,Co) G T*M. The fact that this mapping is continuous is an easy 
consequence of the definition of the parallel translation along a curve as a solution 
to an ordinary linear differential equation. 

Remark 6.12. Consider a finite-dimensional manifold M embedded in K n , so 
T*M C K 2 ™. Assume that M satisfies the following condition: 

Ve 3 S > 0: v, h G TM X x e M, \\v\\ x < 5 =^ \\dexp x (v)(h) - h\\ x < e 
(note in particular that this condition is automatically met when M is compact, 
and in many other natural examples). Then every function F : T*M — > M which is 
uniformly continuous with respect to the usual Euclidean metric in K 2n is intrinsi- 
cally uniformly continuous as well, as is easily seen. Consequently there are lots of 
natural examples of intrinsically uniformly continuous functions F : T*M — > M. 

Now we can prove the following maximum principle for Hamilton-Jacobi equa- 
tions of the form (*). 

Theorem 6.13. Let f, g : M — *■ R be bounded uniformly continuous functions, and 
F : T* M — > M be intrinsically uniformly continuous. If u is a bounded viscosity 
subsolution of u + F(du) = f and v is a bounded viscosity supersolution of v + 
F{dv) = g, then v — u > mf(g — f). 

Proof. If e > is given, then, by Proposition 16.61 there exist p,q £ U, and C € 
D + u(p), £ £ D~v(q) such that 

i) d(p,q) < e, \\( - L qp (£)\\ p < e 

ii) v(x) — u(x) > v(q) — u(p) — e for every x € M. 

Since u and v are viscosity sub and super solutions respectively, we have u{p) + 
F(p,C) < f(p) an d v(q) + F(q,£) > g(q). Hence, for every x S M, 

v{x) - u(x) > v{q) - u{p) - e > g(q) - F(q, - f(p) + F(p, () - e > 
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> inf (g - f) + (f(q) - f(p)) + (F(p, Q - F(q 7 £)) - e. 

Now, if we let e — ► + , we have that f(q) — f(p) goes to because / is uniformly 
continuous. On the other hand, the fact that F is intrinsically uniformly continuous 
implies that F(j>, £) — F(q, £) goes to as e — > + . Consequently we obtain v — u > 
inf( 5 -/). □ 

Proposition 6.14. Let O 6e an open subset of M. Let T be a uniformly bounded 
family of functions on Q, and let u = sup{t> : v G J 7 }. If every v is a viscosity 
subsolution of u + F{du) = 0, then u* is a viscosity subsolution of u + F(du) = 0. 

Proof. Let p G f2 and £ G D + u*(p). According to Proposition 16.91 there exist 
sequences {v n } C T, and {(p n ,(n)} C T*(f2) with £„ G D + v n (p n ) and such that 

i) lim n w„(p„) = u*(p) 

ii) lim„(p„,C„) = (p,Q- 

Since v n are viscosity subsolutions of u + F(du) — 0, we have that v n (p n ) + 
F(p n ,(n) < 0. Hence u*{p) + F(p, Q < 0. □ 

Corollary 6.15. The supremum of two viscosity subsolutions is a viscosity subso- 
lution. 

Theorem 6.16. Let M be a complete Riemannian manifold which is uniformly 
locally convex and has a strictly positive injectivity radius. Let F : T* M — > K be 
an intrinsically uniformly continuous function (see Definition ^. 1 (A above). Assume 
also that there is a constant A > so that —A < F(x,0 x ) < A for every x G M. 
Then, there exists a unique bounded viscosity solution of the equation u+F(du) = 0. 

Proof. Uniqueness follows from Theorem 16.131 by taking / = g = 0. In order to 
show existence, let us define T as the family of the viscosity subsolutions w : M — ► K 
to u + F(du) — that satisfy 

—A < w(p) < A for every p G M. 

The family J- is nonempty, as the function Wo(p) = —A belongs to T (because 
— A+F(p, p ) < 0). Let u be the upper semicontinuous envelope of sup{u> : w G J-}, 
and v be the lower semicontinuous envelope of u. By the definition, we have v < u. 
On the other hand, according to Proposition 16 . 1 41 u is a viscosity subsolution of 
u + F(du) = 0. 

Claim 6.17. v is a viscosity supersolution of u + F{du) = 0. 

Once we have proved the claim, we have that u < v by Proposition 16.131 hence 
u = v is a viscosity solution, and existence is established. 

So let us prove the claim. If v is not a viscosity supersolution, there exist po G M 
and Co G D~v(p) such that v(po) + F(p Xo) < 0. By Theorem 14. 3f 5L there exists 
a C 1 smooth function h : M — > K with Co = dh(po) and such that v — h attains a 
global minimum at po. Hence we may assume that 

v(p ) + F(p , dh(p )) < 0, v(p ) = h{p ), and h(p) < v{p) for all p G M. (1) 

From the inequality h(p) < < u(p) < A we get h(po) < A: otherwise A — h 
would have a local minimum at po, and consequently dh(po) = 0, which implies 
w(Po) + F(p ,dh(p )) = h(p ) + F(p ,dh(p )) = A + F(p o ,0) > A - A = 0, a 
contradiction with (1). 
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Now we can take a number 6 > and a C 1 smooth function b : M — ► [0, oo) 
with support on B(po,5), b(po) > 0, and such that ||fr||oo, | jc£&| joo ar e small enough 
so that 



hip) + b(p) + F{p 1 dh{p) + db(p)) <0 for every p g B(p , 28), and (2) 



We have that w(p) — u{p) if p € fii := M \ B(p ,S), because u(p) > v{p) > 
hip) = hip) + bip) whenever p £ B(p ,2S) \ B(po,S). Therefore w is a viscosity 
subsolution of u + F{du) = on Q.\. On the other hand, bearing (2) in mind, it 
is clear that w is the maximum of two viscosity subsolutions on SI2 := B(po,2S), 
and consequently w is a viscosity subsolution on Q 2 - Therefore w is a viscosity 
subsolution of u + F(du) = on M = f2i U This implies that w € T , since 
—A < u < w and w(p) < A, by (3). 

Finally, we have that u > w, because u > supT . Therefore we have u(p) > 
w(p) > h(p) + b(p) on B(po, 6), and in particular v(po) = u*(po) > ^(po) + &(po) > 
h(Po)> which contradicts (1). □ 

When M is compact, the preceding Theorem takes on a simpler appearance. 

Corollary 6.18. Let M be a compact Riemannian manifold, f : M — > R a contin- 
uous function, and F : T* M — > M an intrinsically uniformly continuous function. 
Then there exists a unique viscosity solution of the equation u + F{du) = f . 

Proof. This follows immediately from Theorem lG.ltjl taking into account the follow- 
ing facts: 1) if M is compact then M is uniformly locally convex and i(M) > (see 
Remarks 12.91 and 12.121 above) : 2) every viscosity solution u is continuous, hence u is 
bounded on the compact manifold M; and of course 3) / is uniformly continuous 
because / is continuous on M, compact. □ 

Remark 6.19. In particular, when a compact manifold M is regarded as embedded 
in K'\ so T*M C M 2n , and F : T*M — ► R is uniformly continuous with respect to 
the usual Euclidean metric in R 2 ™, then Corollary 16 . 1 81 and Remark Itj . 1 21 yield the 
existence of a unique viscosity solution to the equation u + F{du) = f. 

However, the requirement that F is uniformly continuous cannot be relaxed in 
principle, because the cotangent bundle T*M is never compact, so, even though F 
is continuous, we cannot ensure that F is uniformly continuous on T*M . 

Remark 6.20. It should be noted that one may pose a Hamilton-Jacobi problem 
such as 



on a manifold M without presupposing any Riemannian structure defined on M. 
Then one may consider the natural question whether it is possible to find a suit- 
able Riemannian structure g which makes M uniformly locally convex and with a 
positive injectivity radius, and which makes F intrinsically uniformly continuous 
as well. In other words, one can seek for a Riemannian manifold N with positive 




(3). 



u + F(du) = 0, u bounded 



(*) 
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convexity and injectivity radii and a diffeomorphism ip : N — > M so that the func- 
tion G : T*N — > M is intrinsically uniformly continuous, where G — Fo (T*ip), with 
T*ip : T*N -> T*M defined by T*ip(x,r)) := (<ip(x),r)° (dtp- 1 ) (if; (x))) . Then, by 
Theorem 16. 161 the equation 

v + G(dv) = 0, v bounded (**) 

has a unique viscosity solution. But it is obvious that v is a viscosity solution to 
(**) if and only if the function u — v o ip- 1 is a viscosity solution to (*). Hence 
the equation (*) has a unique viscosity solution as well. This means that Theorem 
16. 161 above is applicable to even more situations than one might think of at a single 
glance. The following example reveals the power of this scheme. 

Example 6.21. Let M be the submanifold of R 3 defined by 

1 



2 i 2 ' 

ar + y z 

let F : T*M cM 6 ^l, and consider the Hamilton- Jacobi equation u + F(du) = 0. 
If we endow M with its natural Riemannian structure inherited from R 3 , M will 
not be uniformly locally convex, and besides i(M) — 0, so Theorem 16.161 is not 
directly applicable. Now let us define N by 

Z = 2 i 1 2 7' Z > > 

x z + y z — 1 

with its natural Riemannian structure as a submanifold of R 3 . It is clear that 
N is uniformly locally convex and has a positive injectivity radius. The mapping 
V> ■■ N —> M defined by 



. , ( y/x 2 +y 2 -l ^/x 1 +y 2 - I \ 
b (x, y,z) = I — x, -j^=^= — y, z j 

\ \ T 2 -I- II 2 \ / T. 2 4- II 2 ' 



\/x 2 +y 2 Va^+jr 

is a C°° diffeomorphism. Assume that the function G = F o (T*tp) : T*N — > R 
is uniformly continuous with respect to the usual metric in R 6 . Since N satisfies 
the property of Remark 16. 121 we have that G is intrinsically uniformly continuous. 
Therefore, by the preceding Remark 16.201 the equation u + F(du) = 0, u bounded 
on M, has a unique viscosity solution. 



Now let us see how Deville's mean value Theorem 14 . 1 81 allows to deduce a result 
on the regularity of viscosity solutions (or even subsolutions) to Hamilton- Jacobi 
equations with a "coercive" structure. 

Corollary 6.22. Let M be a Riemannian manifold, and F : R x T*M — > R a 

function. Consider the following Hamilton- Jacobi equation: 

F{u{x),du{x)) =0. (HJ3) 

Assume that there exists a constant K > such that F(t, £ x ) > whenever \\Cx\\x > 
K and t € R. Let u : M — * R be a viscosity subsolution of (HJ3). Then: 

(1) u is K-Lipschitz, that is, \u[x) — u(y)\ < Kd(x,y) for every x, y € M. 

(2) If M is finite dimensional, u is Frechet differ entiable almost everywhere. 

(3) If M is infinite- dimensional u is Frechet differ entiable on a dense subset of 
M. 
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Proof. If u is a viscosity subsolution then F(u(x),( x ) < for every x £ M and 
Ct £ D~u(x). Hence ||£a;|| < K for every ( x £ D~u(x) (otherwise F(u(x)Xx) > 0, 
a contradiction). Then, by Theorem l4.18l u is if-Lipschitz. 

On the other hand, (2) and (3) follow immediately from Theorem 15. 71 □ 

Let us conclude with a brief study of a HJ equation which is not of the form 
(*) above, but which is still very interesting because of the geometrical significance 
of its unique viscosity solution. Let M be a complete Riemannian manifold, 51 
a bounded open subset of M, and let <951 be the boundary of 51. Consider the 
Hamilton- Jacobi equation 

, , J 1 1 <iit (x) 1 1 £ = 1 for all x £ 51 
( > \ u{x) = for all x £ dVt. 

There is no classical solution of (HJ4) . Indeed, if we had a function ti:f!cM^l 
which is differentiable on 51 and satisfies = 1 for x £ 51 and u = on <951, 

then we could apply Theorem l3.1l to find a point xq £ 51 so that ||<iu(:x;o)IUo < 1/2, 
a contradiction. 

Nevertheless, we are going to see that there is a unique viscosity solution to 
(HJ4), namely the distance function to the boundary <951. By definition, a function 
it is a viscosity solution to (HJ4) if and only if u is continuous; u = on <951; 
HCIU > 1 for a11 C e D-u(x), x £ O; and ||C|U < 1 for all C £ D+u(x), x £ fl. 

Theorem 6.23. Let M be a complete Riemannian manifold, and fl a bounded open 
subset of M with boundary dQ. Then the function x i— * d(x, dil) mi{d(x, y) : 
y £ dn} is a viscosity solution of the equation (HJ4). Moreover, if M is uniformly 
locally convex and has a positive injectivity radius, then d(-,dfl) is the unique vis- 
cosity solution of this equation. 

Proof. Let us first check uniqueness. Assume u, v : Q — * K are viscosity solutions 
of (HJ4). Since u and v are continuous, and u = v = on <90, we can extend u and 
v with continuity to the whole of M by setting u — — v on M \ ft. It is enough 
to see that u < v on Q (in a similar way, or by symmetry, v < u, hence u — v). To 
this end we take any a £ (0, 1) and we check that au < v. Indeed, suppose we had 
that inf{w(a;) — au(x) : x £ 51} < 0. Pick e with 



in | — ~ m ^{ v ( x ) ~ au{x) : x € £1} |. 



< 2s < min 

Note that, as u and v are viscosity solutions, we have ||CIU < 1 for every £ £ 
D + u(x) U D + v(x), x £ 51, so by the mean value Theorem 14.181 u and v are 1- 
Lipschitz. In particular, since 51 is bounded we have that u and v are bounded. 
Then, according to Proposition 16.61 there exist xo,yo S M, £ £ D + (au)(xo), 
£ £ D~v(yo) with 

(1) d(x ,yo) < e 

(2) ||C-i»oyo(OHxo <e 

(3) inf(u — au) > v(yo) — au(xo) — e. 

Taking into account the facts that u and v are 1-Lipschitz, and u — v = on A/\ 51, 
it is easy to see that (3) and the choice of e imply that xo, yo £ 51. Now, since u 
and v are viscosity solutions we have that 

-C£D+u(x ) =^ II— ClUo < 1 => IICIL, and 
a a 
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£ G D-v(y ) =J- U\\vo > 1. 
Now, from (2), and bearing in mind that L Xoyo is a linear isometry, we get that 

1 < \\i\\ yo = \\L Xoyo {0\\ Xo < HCllxo +e < a + £< 1, 

a contradiction. 

Now let us prove that u := d(-,c?Q) is a viscosity solution to (HJ4), hence the 
only one. The property u — on dfl is obvious from the definition, so we only have 
to check the conditions on the norms of the vectors of D~u(x) and D + u(x), for 
X £ fi. 

Step 1. Take £ G D~u(x), x £ O. We have to see that \\£\\ x > 1. By Theorem IP 
we can pick a C 1 smooth function ip : M — > R so that — f(y) > u{x) — <p(x) = 
for all y £ M. Fix < e < 1. Now, for every a with < a < d(x, c?f2), by the 
definition of d(x, we can take x a £ d£l with 

sex 

d(x,dCl) > d(x,x a ) — — . 

Next, by making use of Ekeland's approximate Hopf-Rinow type Theorem 12.21 we 
can find a point y a £ Q with 

d(x a ,y a ) < — 

and a geodesic 7 Q : [0, T a ] — > ft C M joining x = 7 Q (0) to y a — 7 Q (T Q ), and such 
that L(-y a ) = d(x, y a ). Then we have 

L(la) = d(x,y a ) < d(x,x a ) + d(x a ,y a ) < d(x,x a ) + — < d(x,dCl) + — , 

that is 

d(x,dn)>L( la )- £ -^. (4) 

Set v a = d'y a (0)/dt £ TM X , so that 7 a (t) = exp x (tv a ) and ||w Q |U = 1, and define 
z a = 7a (oO- Then we have 

ip(z a ) — tf(x) < u(z a ) — u(x) = d{z ai dtt) — d(x. dfl) < 

COL s £CK 

d(z a , dfi) - L(j a ) + — < d(z a ,y a ) + d(y a , x a ) - L(j a ) + — < 
ea * . ea 



hence 



<-l + £ . (5) 

a 

By the mean value theorem there is s a £ [0, a] such that 

dtp("/ a (s a )){ — — = . 6 

dt a 

By combining(5) and (6), and bearing in mind that \\d"/ a (s)/dt\\^ a ^ = 1 for all s, 
we get that 

||<M7a(sa))|| 7a ( ao ) > 1 -e (7) 
for every a £ (0,u(x)). Then, since the functions y — > dip(y) and (y, C) — * HCIIy are 
continuous, and 7 a (s a ) = exp a ,(s Q ,u Q ) — > exp a ,(0) = x as a — > 0, it follows that 

UWx = \\dip(x)\\ x = lim ||^(7a(s a ))|L a ( ao[ ) > 1-e. (8) 

a— »0+ 
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Finally, by letting e — > in (8), we deduce that ||£|| x > 1. 

Step 2. Now take ( <G Z? + u(:r), a; € f2, and let us see that HCIU < 1- This is 
much easier. Pick a C 1 smooth function ip : M — > K so that dip(x) — £ and 
— < — 4>( x ) = for all y g M. For each w g TM X consider the 
geodesic 7„(i) = exp 2 ,(to). Since u = d(-, dSl) is 1-Lipschitz we have that 

i>(7v(t)) - ^(7»(0)) > «(7t>(*)) - «(7«(0)) > -d(7»(*),7«-(0)) = 

I16IIC6 

for all t > small enough, and 

#(,)(,) = lim ^W)-^(O)) > _ L (Q) 
t^o+ t 

As (9) holds for every v g TMj, we conclude that ||C|| X = ||#(a;)|| x < 1. □ 
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